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ABSTRACT 



The present invention provides a method, apparatus, and 
system for dynamically changing the sizes of power-control 
pools that are used to control the power consumption levels 
of memory devices. In one embodiment, a request to change 
the sizes of the memory power-control pools is received. In 
response to receiving the request to change the sizes of the 
memory power-control pools, the memory devices are 
placed in a specific operating mode or power state after 
being refreshed in a periodic refresh cycle. In response to a 
signal indicating that all memory devices have been placed 
in the specific operating mode, powercontrol pools are 
resized according to pool size values corresponding to the 
request received. 
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METHOD AND APPARATUS FOR active mode and which devices are in inactive mode can be 

DYNAMICALLY CHANGING THE SIZES OF accomplished through a definition of pools of devices that 

POOLS THAT CONTROL THE POWER are used to keep track of the operational mode or power state 

CONSUMPTION LEVELS OF MEMORY (e.g., active or inactive) of the individual devices. A pool of 

DEVICES 5 devices in this context refers to a mapping or list of devices 

that are in a specific operational mode or power state. For 

FIELD OF THE INVENTION example, one pool may be maintained to keep track of the 

™ . .. * t . * j * , devices that are in active mode and another pool may be 

The present invention relates to the power and thermal . , . , A . A . c 4 . , . ..... \- 

r , c 4 A v. j • xm maintained to keep track of the devices that are in inactive 

management of computer systems and devices. More , TT , , r 4 , iL . 

.? „ , L . ■ 1- i * . 10 mode. Under such a power management scheme, the devices 

specifically, the present invention relates to an apparatus, 4 , . * , . to . ' 

*u j j * r j ii * ii- *iT represented in one of the pools are assumed to be operating 

method, and system for dynamically controlling the power . r _ . i j , , !l r 

t » r j ■ • . m a certam operational mode or power state and therefore 

consumption levels of memory devices in a memory system. *V . , r r- i j • 

r J J J consuming a certain amount of power. For example, devices 

BACKGROUND OF THE INVENTION ^ at are re P resente d m me active pool are assumed to be 

is operating in active mode. The number of devices in each 

As computer devices and systems continue to advance pool may be examined to determine the amount of power 

and become more complex, effective and efficient power and being used by the entire memory system. The different pools 

thermal management of computer devices and systems have utilized to keep track of the operational mode or power state 

become more and more critical in system design and imple- 0 f the various memory devices are also referred to as the 

mentation. Since computer devices and systems can only 20 power-control or power-saving pools hereinafter, 
operate properly and safely within certain electrical power Conventionally, the number of devices in each pool (also 

and temperature ranges, it is important to ensure that there referrcd to as me size of me pool or pool size ncrcinafter ) is 

is sufficient power supply to operate various devices when configured or specified by the BIOS at start up or reset and 

they are needed. In addition, it is also important to ensure kft urjchangcd during systcm operations because of the 

that thermal conditions do not exceed some threshold levels 25 comp i exity of accounting for the power consumption states 

that are considered safe for the operations of these various of all devices during any proposcd transition. For example, 

devices. In general, computer devices such as memory a system operator or system user may specify through BIOS 

devices are designed to have different operating modes or setup that me number of active devices i$ g and the Qumber 

power states that correspond to different levels of perfor- of inact ive devices is 24. These two numbers are used to 

mance and power consumption. The different operating 30 determine the maximum allowable number of devices that 

modes or power states may include, for example, active can be in the active and inactive poolS) respectively. Such a 

mode, standby mode, nap mode, etc. Generally, devices static and inflexible pool configuration is not effective and 

operate faster in active mode than they do in other modes. efficient in balancing the system performance requirements 

However, devices also consume more power and generate ^ me system power ^ heat dissipalion requirements 

more heat in active mode than they do in other modes. 35 because certain events and operating conditions may occur 

Keeping all devices in the system in active mode reduces during tne course of the tem operation wnich could 

operational latency and therefore improves system overall rcquire the pooI to be changcd for thc system 

performance. However, keeping all devices in active mode to contimje t0 operate prop erly, safely, and efficiently. In 

consumes more power and generates more heat dissipation. vadous instances> for example , it be t0 bc able 

In addition, even if the system power supply source is 40 to change the pool configuration (e.g., change the size of the 

sufficient to power all devices in the system, some of these active pool ^ inactive ^ etc } during tne system 

devices may be idle anyway and therefore it would be a tions in response to various extemal stimuli 0f changes ^ 

waste of resources to keep them in active mode all the time. operational conditions since the sizes of the pools are used 

System performance requirements and system power usage to maintain a pfoper balance between system performance 

requirements need to be balanced. To maintain a balance 45 and system power consumption (and heat generation). For 

between system performance and system power usage and examplCj the sizes of the poo[s may need t0 be changed ^ 

heat dissipation, it is necessary to keep some number of reS p 0 nse to a temperature condition that exceeds the system 

devices in an inactive mode to reduce power usage and heat acccpta ble thermal tolerances or in response to an indication 

dissipation. Depending on the applications and the opera- lhal the syslem is operalmg from baltery power due 

tional environment, the number of devices to be kept in 50 to a power failure or outage. In addition, the sizes of the 

inactive mode may vary. pools may need to be changed due t0 changes in the system 

The system constraints and tradeoffs described above with operational characteristics such as changes in the number of 

respect to computer devices in general apply equally to system users which generally affect the usage and therefore 

memory devices in memory system. In their active or most me power consumption levels of the memory system, 
power-hungry mode, memory devices such as dynamic 55 As a result, there exists a need to dynamically reconfigure 

random access memory (DRAM) devices operate faster than or change me sizes of poW er-control pools of memory 

they do when they are in mactive mode (e.g., standby or nap dcviccs during mc coursc of ^ system opcrat i ons . 
mode). However, DRAM devices in their active mode also 

consume far more power than they do when they are in SUMMARY OF THE INVENTION 

inactive mode. As a result, to maintain a balance between 60 The present invention provides a method, apparatus, and 

performance and power consumption (and heat dissipation), system for dynamically changing the sizes of power-control 

some fixed number of DRAM devices may need to be kept pools that are used to control the power consumption levels 

in an inactive mode to conserve power and reduce heat of memory devices. In one embodiment, a request to change 

dissipation. The number of devices in active mode and the the sizes of the memory power-control pools is received. In 

number of devices in inactive mode can be specified by the 65 response to receiving the request to change the sizes of the 

Basic Input/Output Program (BIOS) at system start up memory power-control pools, the memory devices are 

(boot) or system reset. Management of which devices are in placed in a specific operating mode or power state after 
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being refreshed in a periodic refresh cycle. In response to a for dynamically changing the sizes of memory power- 
signal indicating that all memory devices have been placed control pools that are used to keep track of and control the 
in the specific operating mode, power-control pools are operational states of various memory devices. In one 
resized according to pool size values corresponding to the embodiment, the refresh process normally used to refresh 
request received. s mc various memory devices is modified to make the various 

memory devices enter a specific operational state, e.g., the 

BRIEF DESCRIPTION OF THE DRAWINGS nap state, after being refreshed in response to a request to 

change the sizes of the memory power-control control pools. 

The features and advantages of the present invention will ^ me various mcmory dcviccs havc cntcrcd thc spedfic 

be more fully understood by reference to the accompanying ^ operational state (e.g., the nap state), the sizes of the memory 

drawings, in which: power-control pools can be changed to new values accord- 

FIG. 1 is a block diagram of one embodiment of a system ing to the request. In one embodiment, the request to change 

implementing the teachings of the present invention; the sizes of the memory power-control pools can be initiated 

FIG. 2 shows a block diagram of a memory controller by a processor or other units that have a need for changing 

having a memory power consumption control mechanism; 15 the sizes of the memory power-control pools. In one 

FIG. 3 illustrates a block a diagram of one embodiment of embodiment, the request to change the sizes of the memory 

a memory control unit containing a pool manager; powerncontrol pools can also be initiated, without system 

aa Ar*-n 4 * 1 r ... A c software intervention, in response to detecting a specified 

FIGS. 4A-4C illustrate an example of one embodiment of t - . *\ . , . 

t i 1 $ . . . , « 4 system event, for example a signal from a system thermal 

a method for managing various power-control pools that are 3 4 , . ' r % A . ,. A . . A 

used to keep track of and control the operational states of ™ <= onlro1 ° r a memo ^ rol ^Vindicating tha 

memo devices* temperature has exceeded a threshold level. The teachings of 

m6 ™°^ -t^^f'ii , . r tne P resent invention are applicable to any scheme, method 

FIGS. 5A-5C illustrate an example of one embodiment of and system for power managem ent of memory devices, 

a method for managing power-control pools that are used to However, the present invention is not limited to the power 

keep track of and control the operational states of memory ^ and thermal mana gement of memory devices and can be 

devices; applied to the power and thermal management of other 

FIG. 6 shows a state diagram of one embodiment of a devices, 

process for performing normal memory refresh operations; FIG. 1 shows a block diagram of one embodiment of a 

FIG. 7 shows a state diagram of one embodiment of a system configuration in which the teachings of the present 

process for performing refresh operations in response to a 30 invention are implemented. The system configuration 100 

request to resize the power control pools; includes a plurality of central processing units (CPUs) 

FIGS. 8A-8B show an example of a reconfiguration of the lOla-d, a memory control hub (also referred to as memory 

power control pools in response to a request to resize the control unit) HI, a P64 control unit 121, an Input/Output 

power control pools; (10) control unit 131, a graphics controller 141 coupled to 

FIG. 9 is a block diagram of one embodiment of an 35 a graphics subsystem 151, and a plurality of memory devices 

apparatus for dynamically changing the sizes of memory 161 For me P™V°™s of the P^ent specification, the term 

power-control pools; "processor" or "CPU" refers to any machine that is capable 

m- ui \ a- * . j • . c of executing a sequence of instructions and shall be taken to 

FIG. 10 is a block diagram of one embodiment of an ; n „\„A~ u,.» „„* 1 t ^A . 1 

r j • 11 i_ • 4 «_ • r include, but not be limited to, general-purpose 

apparatus for dynamically changing the sizes of memory • . , . & 

power-control pools- y ^ microprocessors, special purpose microprocessors, multi- 

v ^ ' media controllers and microcontrollers, etc. In one 

FIG. 11 shows a block diagram of one embodiment of an embodiment, the CPUs lOla-lOld are general-purpose 

apparatus for dynamically changing the sizes of memory microprocessors that are capable of executing an Intel 

power-control pools; Architecture instruction set. The CPUs 101a-101d, the P64 

FIG. 12 shows a flow diagram of one embodiment of a 45 control unit 121, the 10 control unit 131, and the AGP 

method for dynamically changing the sizes of memory graphics control unit 141 access the system memory devices 

power-control pools in response to a request from a proces- 161 via the memory control unit 111. The memory control 

sor; unit 111, in one embodiment, is responsible for servicing all 

FIG. 13 illustrates a flow diagram of one embodiment of memory transactions that target the system memory devices 

a method for dynamically changing the sizes of memory 50 161. The memory control unit 111 can be a stand-alone unit, 

power-control pools in response to hardware-detected sys- 111 integrated part of a chipset, or a part of some larger unit 

tern events; and th at control the interfaces between various system compo- 

F1G. 14 illustrates a flow diagram of one embodiment of nents md thc s y stcm mc m or y deviccs 16 1- Th© P64 control 

a method for dynamically changing the sizes of memory umt 121 P rovides ^ ^terface control between a plurality of 

power-control pools in response to a processor's request or 55 PCI_64 slots 125 and the memorv C0Qtrol ^ Th e 10 

hardware-detected system events. contro1 umt 131 P r0Vlde s the interface control between the 

memory umt 111 and various 10 devices and ports including 

DETAILED DESCRIPTION me ^1 slots and PCI agents 133, a plurality of USB ports 

135, a plurality of IDE ports 137, and other 10 devices 139. 

In the following detailed description numerous specific 60 The AGP graphics control unit 141 provides the interface 

details are set forth in order to provide a thorough under- control between the graphics subsystem 151 and the 

standing of the present invention. However, it will be memory control unit 111. The structure and functions of the 

obvious to one skilled in the art that the present invention memory control unit 111 are described in greater details 

may be understood and practiced without these specific below. 

details. 65 p or me purposes of the present specification, the memory 

In the discussion below, the teachings of the present devices 161 are assumed to be dynamic random access 

invention are utilized to implement a method and apparatus memory (DRAM) devices. It is well known that DRAM is 
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a type of RAM that uses volatile storage cells which are various sources within the system 100 include memory data 

periodically refreshed in order to hold data. The rate of read and write requests. In one embodiment, the MCU 111 

refresh or frequency of refresh varies depending upon the translates the read and write requests received from the 

type DRAM used, the amount of memory installed, the various sources into commands that are understood by the 

configuration of the system memory, etc. In the discussion $ RDRAM devices that are coupled to the MCU 111 via the 

that follows, it is also assumed that the memory devices used memory bus. The commands understood by the RDRAM 

are RAMBUS® DRAMs (also referred to as RDRAMS) that devices (i.e., the RDRAM native requests) are also called 

are designed by Rambus Inc. of Mountain View, Calif. RDRAM request packets or simply packets herein. The 

Everything discussed herein, however, is equally applicable packet generator unit 321 shown in FIG. 3 is the unit within 

to other types of DRAMs including conventional DRAMs, 10 tnc MCU 111 that is responsible for creating and sending 

fast page mode (FPM) DRAMs, extended data out (EDO) packets to the RDRAM devices. 

DRAMs, burst extended data out (BEDO) DRAMs, syn- In one embodiment( me MC TJ 311 is also responsible for 
chronous DRAMs (SDRAMs), double data rate SDRAMs RDRAM maintenance operations such as refresh and cali- 
(DDR SDRAMs), synchronous-link DRAM (SLDRAMs), bration M explained ^ RDRAMs, like any other 
elc ' 15 DRAM technology, uses volatile storage cells which must be 
FIG. 2 shows a block diagram of one embodiment of the refreshed periodically in order to hold data. The MCU 311 
memory control unit 111 described in FIG. 1. In this perform these maintenance operations at regular intervals by 
embodiment, the memory control unit 111 contains three sending packets to the RDRAMs to instruct them to refresh 
major blocks, the host group (HG) 211, the 10 group (IOG) me i r data or to calibrate their electrical characteristics. In 
221, and the data group (DG) 231. In one embodiment, the 20 one embodiment, the MCU 111 uses the refresh unit 311 
host group 211 functions as a host interface for the memory shown in HG 3 t0 perform the RDRAM maintenance 
control 111. Some of the functions performed by the host operations. In one embodiment, the refresh unit 311 main- 
group 211 include receiving transaction requests from the tains a couate r used to keep track of the intervals of time 
CPUs 101a-101</, generating appropriate commands to both between refresh or calibration cycles. When the refresh unit 
the 10 group 221 and the data group 231, receiving 2 5 311 has determined that a maintenance cycle needs to be 
responses from the 10 group 221 and the data group 231, and performed on the RDRAMs, it places a request to the packet 
transmitting the responses received to the host (CPUs generator 321, which in turn creates the appropriate 
101a-101<Q. In addition, the host group 211 is also respon- RDRAM request packets that cause the RDRAM devices to 
sible for generating snoop requests to the data group 231, perform the required maintenance functions (e.g., refresh or 
receiving snoop responses from the data group 231, and 30 calibrate) 

transmitting snoop responses to the host. The 10 group 221, r™ . 111 • *ui ~ • *u 

f j- * £ x^v - . r r Ihe P°°l manager 331 is responsible for managing the 

in one embodiment, functions as an 10 interface for the , , „ *• 1 1/1 c 1 * u ■ *u 

.' ^ „ .„ , ¥rt power consumption levels (also referred to herein as the 

memory control unit 111. More specifically, the IO group d modes Qr ^ Qf ^ RDRAM devices 

221 handles the interface functions between the data group M lained ab ^ order \ 0 maintain the balance 

231andtheP64contro urnt m, he 10 control unit 131, 35 between tem performance md system ower 

and the graph.cs control unit 141. In one embodiment, the ffle deyices are desi d tQ haye J 

data group (also referred to as data cluster) 231 .s respon- modes ^ co nd to mtKBl performance levels « e 

sible for dispatching and completing all memory transac- ds) , n , he embo diment, the RDRAMs are 

10ns that target the system RDRAMs. In one embodiment, desj d , 0 haye d modes; ^ st4ndb 

the data group 231 contains two logtcal subcomponents: a to and powcrdown . ^ four different ati modes 

data uoi (Dunit) that performs the intricate mechanics of of ^ RDRAMs m distinguished by two factors: their 

sending transactions o the RDRAM devices via the RAM- consumption levels and their performance levels. For 

BUS channel controller (RAC) and the buffer unit (Burnt) , a RDRAM fa ^ mode ^ fead tQ 

tot ^responsible for sequencing buffering and delivering sefvice a transaclion . Ho er CODSUmption * also 

data mat are pulled from or pushed to the RDRAM dev.ces 45 hi ner in active mode than the other ^ ^ four 

across the memory bus (also referred to as the RAMbus). d;fferent er co tion levels a[ld levels 

The Dumt accepts memory read, write, and refresh requests of ^ RDRAMs corresponding t0 me four meKDl oper . 

from the Burnt. These requests are decoded to determine the Am „ ^ •« : A - °., + . , . , ■ 4 . 

f . M , . , , , rx, ating modes are illustrated in table 1 below, where 4 m the 

status ot the memory pages to which they are targeted. The 4 - t , 4 , 4 , , 

^ .. , m . 3 t & , power consumption column corresponds to the highest level 

Dumt then generates the appropriate commands or instruc- 50 of consumpt ion by the RDRAM and 1 in The perfor- 

Uons (also called the packets) necessary to carry out the mance kyd co]umn c onds tQ me h; ^ est k F vel of 

memory access requests and queues up the packets for erformance 
transmission across the memory bus. In addition, the Dunit 

also synchronizes data transfers that cross a clock boundary TABLE 1 
between the core frequency and the base frequency of the 55 
memory bus. The Bunit, in one embodiment, receives 
requests for memory data from the host group 211 and the 
10 group 221 and generates the appropriate memory access 
requests to the Dunit as described above. 

FIG. 3 shows a block diagram of one embodiment of the 60 
memory control unit 111 that contains a refresh unit 311, a 
packet generator 321, and a pool manager 331. The func- 
tions of these units and the interactions between them are 

described in more details below. As mentioned above, the As illustrated in table 1, RDRAMs operate faster in active 

memory control unit (MCU) 111 is responsible for handling 65 mode than in the other three modes. However, RDRAMs 

memory transactions received from various sources in a also consume much more power in active mode than in the 

timely fashion. The memory transactions received from other three modes. Power consumption and also heat pro- 
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duction of memory devices (e.g., RDRAMs in the present As described above, in one embodiment, the pool man- 
discussion) can be reduced by placing one or more ager 331 maintains information about the operating mode of 
RDRAMs in a lower power mode (e.g., standby, nap, or each individual devices (i.e., which devices are in active, 
power-down mode). As explained above, power and thermal standby, or nap modes) through the use of a plurality of 
management in modem and often complex computer sys- $ pools where each pool refers to a mapping or list of devices 
tems have become more and more critical in system design that are in a specific operating mode or power state). In one 
and implementation. To achieve some acceptable balance embodiment, the pool manager 331 uses three pools to keep 
between system performance and system power consump- track of the operating modes of the memory devices. One of 
tion (which also corresponds to beat dissipation), systems the pools, called the active pool or pool A, is used to keep 
are typically configured so that only a fixed number of 1Q track of which devices operating in active mode. The other 
memory devices (e.g., RDRAMs) is allowed to operate in ca Ued the standby pool or pool B, is used to keep track 
active mode. As explained above, depending on the appli- of which devices operating in standby mode. The remaining 
cations and system operational environments, the number of pool) called me nap pool or pool c ^ uscd t0 kccp of 
memory devices to be kept in active mode varies^ For which devjces operating in nap mode , Eacb of me three 

example in a system configuration using 12 RDRAM pook therefore contains references to the devices that are in 

memory devices, certain system constraints may dictate that 15 n , . . T 

, ' ' r^nrMiAwj * u n j. i_ a specific operating mode or power state. In one 

only a maximum of 4 RDRAM devices can be allowed to be , r ,. 4 . , ° . . 4 < i . * 

active at any given time. As described above, the maximum embodiment the information in die active pool and the 

number of devices in active mode, in standby mode, or in stan , db y P°° l are ^ red L in a u set of re &f ers the na P 

nap mode, etc., can be specified by the system user through P° o1 K r e Pr esented by the subtractive subset of the memory 

system BIOS at system start up or reset. Management of 20 devices that are Dot found in eithe r the active pool or the 

which devices are in which operating mode (e.g., active, standby pool. While the teachings of the present invention 

standby, nap, etc.) can be accomplished using a definition of are discussed herein using pools as an example of a mecha- 

pools of devices (also referred to as power-control pools) nism for maintaining information about the operating modes 

that are used to keep track of and control the operating mode of memory devices, it would be obvious to one skilled in the 

or power state of the individual memory devices. A pool in 2 $ arl mat tne pres 61 * 1 invention equally applies to other 

the present discussion refers to a mapping or list of memory methods, mechanisms or protocols for maintaining and 

devices that are in a specific operating mode or power state. controlling operating modes of the memory devices. 

Continuing with the present discussion, as noted above, In one embodiment, the MCU 111 can have two modes of 

RDRAMs can consume a substantial amount of power and operations with respect to the operating mode configuration 

generate a substantial amount of heat when operating in 30 of the RDRAM devices. In the first mode, all devices are 

active mode. As a result, it would be beneficial to operate as assumed to be in either in active or standby mode. In this 

many RDRAMs as are practical in a low power state. In one configuration, all active devices are represented by tokens in 

embodiment, the MCU 111 accomplishes this throttling by pool A (the active pool), pool B is unused, and pool C 

placing a number of memory devices (e.g., the RDRAMs) subtractively contains all devices that are not represented in 

into nap mode in which the memory devices consume much 35 pool A. As a result, all devices represented in pool C are 

less power and therefore generate much less heat than they assumed to be in standby mode. In the second mode of 

do in active mode or standby mode. RDRAMs in nap mode operation, the memory devices may be in active, standby, or 

can retain their data but are unable to provide their data to nap modes. All three pools A, B, and C are utilized in this 

the MCU 111 until they are moved into either active or configuration. Pool A represents all active devices, pool B 

standby mode. As explained above, to maintain a balance 40 represents devices that are in standby mode, and pool C 

between system performance and power consumption, only subtractively is used to represent all devices that are neither 

some fixed number of memory devices should be put into in pool A nor pool B and are therefore assumed to be in nap 

nap mode at any given time. Consequently, only some fixed mode. 

number of memory devices are to be kept in active or In one embodiment, the pool manager 331 employs true 

standby mode at any given time. Computer programs are 45 least-recentlyused (LRU) algorithm to maintain the list of 

unaware of the operating mode or power state of any given devices represented in pools A and B. FIGS. 4A-4C illus- 

memory device. Therefore, the operating mode of a given trate an example of the configuration and maintenance of the 

memory device may need to be changed by the MCU before three pools A, B, and C when the MCU 111 operates in the 

that particular memory device can service a memory trans- second operation mode (i.e., the memory devices may be in 

action. 50 active, standby, or nap modes). In this example, both pool A 

Referring again to FIG. 3, the pool manager 331 within and pool B are assumed to be set to the sizes of 4 and may 

the MCU 111 is the unit responsible for maintaining the therefore each represent up to four memory devices. It is 

balance between the power consumption of the RDRAM also assumed in this example that there are 12 memory 

devices and their corresponding performance levels. More devices in the system, labeled from A to L. 

specifically, the pool manager 331 keeps track of the oper- 55 FIG. 4A shows a configuration of the three pools A, B, and 

ating mode of each individual memory device and takes C at some given point in the course of system operations. At 

appropriate actions to move the memory devices from one this stage, as shown in FIG. 4 A, devices A-D are repre- 

operating mode to another based upon various factors sented in pool A and therefore assumed to be in active mode, 

including the maximum number of devices allowed in each Devices E-H are represented in pool B and therefore 

operating mode, which device is required to service a 60 assumed to operate in standby mode. Devices I-L are 

particular memory transaction, etc. In one embodiment, in represented in pool C and therefore assumed to be in nap 

order to change the operating mode of a particular memory mode. In the present example, the device listed at the top of 

device, the pool manager 331 requests the packet generator the list (e.g., device A in FIG. 4A) is considered the most 

to send the appropriate packets (i.e., commands) to the recently used while the device listed at the bottom of the list 

memory device that instruct the memory device to perform 65 (e.g., device D in FIG. 4A) is considered the least recently 

the required function (e.g., changing from active to standby used. Using the pool representation shown in FIG. 4A, the 

mode or changing from standby to nap mode, etc.). three pools A, B, and C would be transformed to those 
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represented in FIG. 4B after a read or write to a location in 
device D. The "D" token representing device D would move 
to the most recently used position (the top of the list) in pool 

A, while pools B and C would be unaffected since the 
change with respect to device D did not affect the number of 5 
devices allowed in each pool. Assuming that device I were 
accessed next, then the three pools A, B, and C would be 
transformed to those shown in FIG. 4C. In this case, device 

I was moved to the most recently used position in pool A. 
•Because device I was changed from nap mode to active 3Q 
mode, device C which was the least recently used device in 
pool A was moved to the most recently used position in pool 
B in order to maintain the maximum allowable number of 
active devices in pool A. Similarly, since device C was 
changed from active mode to standby mode, the least 15 
recently used device in pool B (i.e., device H) was kicked 
out of pool B and subtractively moved to pool C in order to 
maintain the maximum allowable number of devices in pool 

B. FIG. 4C therefore represents the pool representation of 
the three pools A, B, and C after the corresponding devices 2 q 
have changed to their appropriate operating modes. 

FIGS. 5A-5C illustrate an example of the configuration 
and maintenance of the three pools A, B, and C when the 
MCU 111 operates in the first mode (i.e., the memory 
devices are assumed to operate either in active or standby 2 5 
mode). In this example, pool A is assumed to have the 
maximum size of four which means that up to four devices 
are allowed to be active at any given time. Pool B is not 
used. It is also assumed in this example that there are 12 
memory devices in the system, labeled from A to L. 30 

FIG. 5 A shows a configuration of the three pools A, B, and 
C at some given point in the course of system operations. At 
this stage, as shown in FIG. 5A, devices A-D are repre- 
sented in pool A and therefore assumed to be in active mode. 
Devices E-L are subtractively represented in pool C (i.e., 35 
since these devices are not represented in pool A, they are 
assumed to be in standby mode). Again, in the present 
example, the device listed at the top of pool A (e.g., device 
A in FIG. 5 A) is considered the most recently used while the 
device listed at the bottom of pool A (e.g., device D in FIG. 40 
5 A) is considered the least recently used. Using the pool 
representation shown in FIG. 5A, the three pools A, B, and 
C would be transformed to those represented in FIG. 5B 
after a read or write to a location in device D. The "D" token 
representing device D would move to the most recently used 45 
position (the top of the list) in pool A, while pools B and C 
would be unaffected since the change with respect to device 
D did not affect the number of devices allowed in pool A. 
Assuming that device I were accessed next, then the three 
pools A, B, and C would be transformed to those shown in 50 
FIG. 5C. In this case, device I was moved to the most 
recently used position in pool A. Because device I was 
changed from standby mode to active mode, device C which 
was the least recently used device in pool A was kicked out 
of pool A and subtractively moved to pool C in order to 55 
maintain the maximum allowable number of active devices 
in pool A. FIG. 5C therefore represents the pool represen- 
tation of the three pools A, B, and C after the corresponding 
devices have changed to their appropriate operating modes. 

As explained above, to maintain a balance between the 60 
system performance, power consumption and thermal 
safety, it is necessary to keep some number of memory 
devices in active mode and the rest of devices in lower 
power states (e.g., standby or nap mode). More specifically, 
since the number of memory devices operating in each of the 65 
power states affects the performance, power consumption 
and heat production levels of the system, it is useful to keep 
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the sizes of the active, standby, and nap pools within some 
initial threshold limits to maintain some balance between 
system performance, power consumption and heat produc- 
tion. Conventionally, the maximum number of devices 
allowed in each pool is configured or specified using the 
system BIOS at start up or reset and left unchanged during 
the course of system operations. Such a static and inflexible 
pool configuration, while providing an initial system balance 
between performance and power consumption, is not effec- 
tive and efficient in balancing the system performance 
requirements with the system power and heat dissipation 
requirements. This is because various events and operating 
conditions may occur during the course of the system 
operations which could require the initial pool configuration 
to be changed for the system to continue to operate properly, 
safely, and efficiently. In other words, the conventional 
method of pool configuration and control does not account 
for the dynamic nature of computer system operations and 
reliability since the changes in the system thermal environ- 
ment or system usage intensity might require a change in the 
operating modes of the memory devices which are con- 
trolled by the pool manager 331. In various instances, it 
would be useful to be able to change the sizes of the pools 
during system operations in response to various external 
stimuli or changes in operational conditions because the 
sizes of the pools are used to maintain a proper balance 
between system performance, system power consumption 
and heat generation. For example, system overheating could 
be used as a trigger to place some of the active memory 
devices into nap mode in order to reduce the heat generation 
capacity of the memory devices. In addition, the sizes of the 
pools may need to be changed in response to an indication 
that the system is operating from lower power source (e.g., 
battery) due to some power failure or outage. Furthermore, 
the sizes of the pools may need to be changed due to other 
changes in the system operational characteristics such as 
changes in the number of system users, etc. 

As explained above, the pool configuration convention- 
ally is left unchanged during system operations because of 
the substantial complexity created in changing the pool size 
during operations. This is because appropriate commands 
must be sent to the RDRAM devices to transition them from 
one state to another, in addition to the movement or update 
of values in the registers used to maintain the operating 
modes or power states of the memory devices. This is 
necessitated by the mandate that the states of the memory 
devices match the states reflected inside the MCU 111. The 
present invention solves this problem by exploiting a char- 
acteristic of the refresh operations performed by the refresh 
unit 311 which requires memory devices to be moved into 
known power states at regular time intervals. More 
specifically, in order to perform refresh operations, all 
memory devices are activated (i.e., transition into active 
mode) before refresh request packets are sent to them. The 
refresh unit 311, in performing periodic refresh operations, 
normally asks that, upon refresh completion, the devices are 
restored by the packet generator 321 to their states before the 
activation. 

FIG. 6 shows a state diagram of one embodiment of a 
process for performing normal refresh operations which 
reflects states of the memory devices that exist in both the 
refresh unit 311 and the packet generator 321, The refresh 
unit 311 enters a wait state at block 601. When the refresh 
counter that is used to keep track of the time intervals 
between refreshes reaches a predetermined target number, 
the refresh unit 311 initiates the refresh operations. At block 
611, a refresh request is initiated that begins the refresh 
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operations. As mentioned above, the refresh unit begins the FIG. 8B, both pools A (the active pool) and pool B (the 
refresh operations by sending a request to wake up or standby pool) pool are empty and all memory devices are 
activate all memory devices to the packet generator 321 represented in pool C (the nap pool). The pool manager now 
which in turn issues the appropriate packets to the memory can resume its normal operations to maintain the pools 
devices. At block 621, a request to wake up all memory 5 according to the new sizes of the pools, 
devices is initiated. In response to a signal indicating that all FIG. 9 shows a block diagram of one embodiment of an 
devices have been activated, a request to refresh all memory apparatus for dynamically changing the sizes of the power- 
devices is initiated at block 631. In response to a signal control pools used to maintain and control the operating 
indicating that all devices have been refreshed, a request to modes of memory devices. In one embodiment, the power 
nap down devices that were in nap mode before the activa- 10 control unit 931 and the DRAM control unit 941 are 
tion is initiated at block 641. After the devices have been contained within a memory control unit 921 that employs 
restored to their states before the activation, the refresh unit the teaching of the present invention described herein to 
311 re-enters the wait state at block 601 to wait for the next dynamically resize the power-control pools. In one 
refresh cycle. embodiment, the power control unit 931 contains a pool 

To allow for a dynamic configuration of the power-control 15 managing unit (i.e., a pool manager) that is responsible for 
pools (i.e., changing the sizes of the pools during system maintaining and controlling the sizes of the power-control 
operations), the present invention modifies the refresh pro- pools and the operating modes of the memory devices. In 
cess described above so that all devices are placed in a one embodiment, the DRAM control unit 941 functions to 
specific mode, for example the nap mode, at the end of the control the various memory transactions that target the 
refresh process instead of just napping down the devices that 20 memory devices and also to perform various maintenance 
were in nap mode before the activation. This method allows operations such as refresh and calibration operations as 
the pool manager 331 to simply reset its pools upon the described above. In one embodiment, the DRAM control 
completion of a refresh operation when such a pool recon- unit 941 includes a refresh unit and a packet generator such 
figuration is desired during the course of system operations. as the ones that are described in FIG. 3. One or more 
In one embodiment, the modified refresh process is initiated 25 processor units (e.g., CPUs) are coupled to the power control 
by a request from the pool manager 331 that a pool resize or unit 931 to send requests for pool resize. As explained 
reconfiguration is required. In one embodiment, when all above, during the course of system operations, it may be 
devices are napped down at the end of the modified refresh necessary or beneficial to change the sizes of the power- 
process, the packet generator 321 and the refresh unit signals control pools in response to various changes in system 
the pool manager 331 to indicate that the pools may now be 30 operations and conditions, for example changes in system 
reconfigured or reinitialized. Once the pools have been thermal environment or system usage levels, in order to 
reconfigured or reinitialized, the pool manager 331 can maintain a balance between system performance, power 
resume its normal operation since it is capable of maintain- consumption, and heat production requirements. When such 
ing the pools after the states of the devices are known. a change is detected, the processor 911 initiates a request to 

FIG. 7 illustrates a state diagram of one embodiment of a 35 resize the power-control pools to the power control unit 931. 

modified refresh process in response to a request to recon- In one embodiment, in response to receiving a request to 

figure or resize the power-control pools. The refresh unit 311 resize the pools, the pool manager within the power control 

enters a wait state at block 701. When the refresh counter unit 931 will initiate a request to the DRAM control unit 941 

that is used to keep track of the time intervals between to stop servicing memory transactions until alt DRAMs have 

refreshes reaches a predetermined target number, the refresh 40 been refreshed. As described above, in this case, the pool 

unit 311 initiates the refresh operations. At block 711, a manager will also instruct the DRAM control unit 951 that 

refresh request is initiated that begins the refresh operations. a pool resize request has been initiated and therefore all 

As mentioned above, the refresh unit begins the refresh memory devices are to be napped down upon completion of 

operations by sending a request to wake up or activate all the refresh. More specifically, the DRAM control unit 941 

memory devices to the packet generator 321 which in turn 45 will perform the modified refresh process described above 

issues the appropriate packets to the memory devices. At so that all memory devices will be placed in a known state 

block 721, a request to wake up all memory devices is (e.g., the nap mode) upon completion of the refresh. The 

initiated. In response to a signal indicating that all devices pool manager within the power control unit 931 will then 

have been activated, a request to refresh all memory devices reinitialize the pools with new sizes upon receiving a signal 

is initiated at block 731. In this example, it is assumed that 50 from the DRAM control unit 941 that all memory devices 

the pool manager has initiated a request for pool resize. have been refreshed and placed in a specific state (e.g., nap 

Because a request to resize the pools has been initiated, mode). After reinitializing the pools, the pool manager can 

instead of proceeding to block 741 to restore the states of the now resume its normal operations to maintain and control 

devices that were in nap mode before the activation, the the pools using the new pool sizes corresponding to the 

process proceeds to block 751 to nap down all memory 55 request received from the processor 911. In one 

devices at the end of the refresh and signal the pool manager embodiment, the processor 911 can supply the information 

when all devices have been napped down. The process then indicating the new sizes with the request to resize. Id another 

re-enters the wait state at block 701 to await the next refresh embodiment, the new size information can be pre-stored and 

cycle. As explained above, by modifying the refresh process, the pool manager can determine which new sizes to be used 

dynamic pool configuration can be achieved. FIGS. 8A-8B 60 by the type of request received from the processor 911. 

show an example of a configuration of the three pools A, B, Applying the teachings of the present invention which 

and C in response to a request to resize the pools. In this enable the dynamic configuration of the power-control 

example, the active pool is to be resized to one and the pools, system software or programs can be modified or 

standby pool is to be resized to one also. FIG. 8A shows the designed to monitor system thermal conditions and generate 

status of the three pools at some point during system 65 appropriate requests to the power control unit to change the 

operations. FIG. 8B shows the status of the three pools upon sizes of the pools when necessary, as illustrated in FIG. 9, to 

the completion of a request to resize the pools. As shown in keep the system operation within a safe temperature region. 
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Unfortunately, thermally induced errors might prevent the 
system from operating normally and therefore may block the 
system software from having its chance to remedy any 
potentially damaging conditions. More specifically, system 
software may not respond fast enough or may itself become s 
inoperable due to thermal errors. Because of this, there 
exists a need for dynamically changing the sizes of the 
power-control pools without system software interventions. 
To solve this problem, the teachings of the present invention 
can be utilized to provide for a mechanism that allows the 10 
memory controller to respond to various thermal conditions 
in a configurable manner that is capable of throttling down 
the power consumption levels of the memory devices 
quickly and without system software intervention. In one 
embodiment, the pool manager described above can be 15 
coupled to receive a signal indicating that a thermal condi- 
tion exceeding some threshold level (i.e., thermal overload) 
has been detected. The signal indicating such a thermal 
overload condition can come from external hardware or 
thermal sensor responsible for monitoring the thermal con- 20 
ditions at component or system level. In addition, the signal 
indicating the thermal overload condition can come from 
other hardware that monitors the thermal conditions of the 
memory devices themselves. In one embodiment, either 
condition will cause the system hardware to respond to 25 
change the sizes of the power-control pools to some safe 
values in order to quickly reduce the power consumption 
level of the memory system. In one embodiment, safe size 
values of the pools can be provided by the system software 
and stored in a register. For example, the information 30 
indicating the sizes of the active, standby, and nap pools can 
be provided by the system software and stored in a register 
accessible by the pool manager. When a thermal overload 
condition is detected, the pool manager will resize the pools 
according to the safe size values stored in the register to 35 
reduce the power consumption level of the memory devices 
to a level that is considered safe. The sizes of the pools that 
are considered safe, of course, can vary depending on the 
system configuration, the power consumption levels of 
memory devices in different power states, the severity of the 40 
thermal overload conditions, etc. Moreover, different levels 
of safe size values can be provided for different system 
events or variations thereof. 

FIG. 10 shows a block diagram of one embodiment of an 
apparatus for dynamically changing the sizes of the power- 45 
control pools in response to various system events without 
system software intervention. In one embodiment, the pool 
manager 1020 is responsible for controlling the sizes of the 
power-control pools without system software intervention. 
In one embodiment, one or more registers are utilized to 50 
store the sizes of the pools that are considered safe sizes to 
be used by the pool manager 1020 when it is necessary to 
resize the pools in response to some specified events indi- 
cated by the output signal of the OR gate 1030. The safe 
sizes or any variations thereof, in one embodiment, can be 55 
provided or programmed by system software. In one 
embodiment, the inputs to the OR gate 1030 can come from 
two different sources. One of the two inputs to the OR gate 
can come from some hardware device responsible for moni- 
toring the thermal conditions of specific components at the 60 
component level or the system at the system level. The other 
input to the OR gate 1030, in one embodiment, comes from 
a thermal sensor or hardware device responsible for moni- 
toring the thermal conditions of the memory system. In one 
embodiment, the output signal of the OR gate 1030 is used 65 
to indicate to the pool manager 1020 that a thermal overload 
condition has been detected. In response to the output signal 
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of the OR gate 1030, the pool manager 1020 initiates a 
request to the DRAM controller 1040 to resize the pools as 
described above, using the safe size values stored in the 
register 1010. 

FIG. 11 shows a block diagram of one embodiment of an 
apparatus for dynamically changing the sizes of the power- 
control pools in response to a resize request from a processor 
(illustrated in FIG. 9) or in response to a hardwaredetected 
signal indicating a thermal overload condition (as shown in 
FIG. 10). In this embodiment, either a resize request 
received from the processor 1110 or a signal from the OR 
gate 1130 will trigger the pool manager 1120 to generate a 
request to the DRAM controller 1140 to resize the pools 
using the modified refresh process described above. As 
explained above, if the processor initiates the request to 
resize, the new size values can be supplied by the processor 
1110 at the time of the request. The new sizes values can also 
be pre-stored and determined by the pool manager 1120 
based upon the type of the request received from the 
processor 1110. If the output of the OR gate 1130 signals a 
thermal overload condition, the safe size values to be used 
can be retrieved from the register 1105. In one embodiment, 
the register 1105 can be programmed by system software. 
Thus, in this configuration, the pool manager 1120 can 
dynamically change the sizes of the pools in response to a 
resize request from the processor 1110 or in response to a 
signal from the OR gate 1130 indicating a thermal overload 
condition. 

FIG. 12 illustrates a flow diagram of one embodiment of 
a method for dynamically changing the sizes of the power- 
control pools in response to a request to resize from a 
processor or other system units. The method 1200 starts at 
block 1201 and proceeds to loop 1205. At loop 1205, a pool 
manager awaits for a request to resize the pools from the 
processor. Upon receiving a request to resize from the 
processor, the pool manager proceeds out of the loop 1205 
to initiate a request to a DRAM controller to resize the pools 
at block 1209. At loop 1213, the DRAM controller proceeds 
out of the wait loop 1213 when the time to refresh the 
memory devices has come. At block 1217, in response to the 
resize request generated by the pool manager, a modified 
refresh process as described above is performed to place all 
memory devices in a specific operating mode or power state 
(e.g., nap mode) at the end of the refresh. In one 
embodiment, the modified refresh process includes activat- 
ing all memory devices, refreshing all memory devices, and 
napping down all memory devices after they have been 
refreshed. At block 1221, the pools are reinitialized by the 
pool manager upon receiving a signal indicating that all 
memory devices have been placed in a known, specific 
operating mode or power state (e.g., nap mode). The method 
then proceeds to end at block 1291. 

FIG. 13 illustrates a flow diagram of one embodiment of 
a method for dynamically changing the sizes of the power- 
control pools in response to system events without software 
intervention. The method 1300 starts at block 1301 and 
enters a wait state at loop 1305. If a signal indicating a 
thermal overload condition is detected, the method then 
proceeds out of loop 1305 to generate a request to resize the 
pools to safe size values at block 1309. At loop 1313, the 
DRAM controller proceeds out of the wait loop 1313 when 
the time to refresh the memory devices has come. At block 
1317, in response to the resize request generated by the pool 
manager, a modified refresh process as described above is 
performed to place all memory devices in a specific oper- 
ating mode or power state (e.g., nap mode) at the end of the 
refresh. In one embodiment, the modified refresh process 
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includes activating all memory devices, refreshing all 
memory devices, and napping down all memory devices 
after they have been refreshed. At block 1331, upon receiv- 
ing a signal indicating that all memory devices have been 
placed in a known, specific operating mode or power state 
(e.g., nap mode), the pools are reinitialized by the pool 
manager using safe size values corresponding to the detected 
thermal overload condition. As described above, in one 
embodiment, the safe size values to be used in response to 
a thermal overload condition or variations thereof can be 
programmed by system software and stored in a register 
accessible by the pool manager. The method then proceeds 
to end at block 1391. 

FIG. 14 shows a flow diagram of one embodiment of a 
method for dynamically changing the sizes of the power- 
control pools in response to a request to resize received from 
a processor (described above with respect to FIG. 12) or in 
response to a hardware-detected signal indicating a thermal 
overload condition (as described above with respect to FIG. 
13). The method 1400 starts at block 1401 and proceeds to 
decision block 1405. At decision block 1405, the method 
proceeds to decision block 1409 if no thermal overload 
condition is detected. Otherwise the method proceeds to 
block 1413. At decision block 1409, the method loops back 
to decision block 1405 if there is no resize request from the 
processor. Otherwise the method proceeds to block 1413. At 
block 1413, the pool manager initiates a request to resize. At 
loop 1417, the DRAM controller proceeds out of the wait 
loop 1417 when the time to refresh the memory devices has 
come. At block 1421, in response to the resize request 
generated by the pool manager, a modified refresh process as 
described above is performed to place all memory devices in 
a specific operating mode or power state (e.g., nap mode) at 
the end of the refresh. In one embodiment, the modified 
refresh process includes activating all memory devices, 
refreshing all memory devices, and napping down all 
memory devices after they have been refreshed. At block 
1431, upon receiving a signal indicating that all memory 
devices have been placed in a known, specific operating 
mode or power state (e.g., nap mode), the pools are reini- 
tialized by the pool manager using the new size values 
corresponding to the condition that triggers the resize 
request. If the resize request is triggered by the processor, the 
new size values to be used can be either supplied by the 
processor when the processor initiates the request or pre- 
stored and determined by the pool manager based on the 
request type received from the processor. If the resize 
request is triggered by the signal indicating a thermal 
overload condition, safe size values corresponding to the 
detected thermal overload condition are used by the pool 
manager to reinitialize the pools. As described above, in one 
embodiment, the safe size values to be used in response to 
a thermal overload condition or variations thereof can be 
programmed by system software and stored in a register 
accessible by the pool manager. The method then proceeds 
to end at block 1491. 

The invention has been described in conjunction with the 
preferred embodiment. It is evident that numerous 
alternatives, modifications, variations and uses will be 
apparent to those skilled in the art in light of the foregoing 
description. 

What is claimed is: 

1. A method of dynamically changing the size of a power 
control pool that is used to manage the power consumption 
of memory devices in a memory system, the method com- 
prising: 

receiving a request to change the size of the power control 
pool; 
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placing the memory devices in a specific operating mode 
after they are refreshed in a periodic refresh cycle; and 
changing the size of the power control pool based upon a 
new size value associated with the request in response 
s to a signal indicating that the memory devices have 
been placed in the specific operating mode. 
2. The method of claim 1 wherein the request to change 
the size of the power control pool is initiated by a processor 
unit. 

10 3. The method of claim 2 wherein the new size value is 
supplied by the processor with the request. 

4. The method of claim 2 wherein the new size value is 
pre-stored. 

5. The method of claim 1 wherein the request to change 
is the size of the power control pool is initiated by a signal 

generated by a control device. 

6. The method of claim 5 wherein the signal generated by 
the control device is used to indicate a thermal condition that 
exceeds a predetermined threshold value. 

20 7. The method of claim 5 wherein the control device is a 
thermal sensor monitoring the thermal condition of the 
memory devices. 

8. The method of claim 5 wherein the control device is a 
thermal sensor monitoring the thermal condition of other 

25 devices. 

9. The method of claim 5 wherein the new size value is 
maintained in a storage unit. 

10. The method of claim 9 wherein the storage unit 
comprises one or more registers. 

30 11. The method of claim 1 wherein receiving comprises: 
receiving the request to change the size of the power 
control pool from a processor. 

12. The method of claim 1 wherein receiving comprises: 
detecting a signal from a thermal control unit indicating a 

35 thermal overload condition outside of the memory 
system. 

13. The method of claim 1 wherein receiving comprises: 
detecting a signal from a thermal control unit indicating 

4Q that the temperature of the memory system has 
exceeded a threshold level. 

14. The method of claim 1 wherein placing the memory 
devices in the specific operating mode comprises: 

performing a periodic refresh cycle including: 
45 activating the memory devices; 

refreshing the memory devices after the memory 

devices have been activated; and 
placing the memory devices in the specific operating 
mode after the memory devices have been refreshed. 
5Q 15. The method of claim 1 wherein changing the size the 
power control pool comprises: 

updating the power control pool to reflect that the memory 
devices have been placed in the specific operating 
mode; and 

55 changing the size of the power control pool to the new 
size value associated with the request received. 

16. The method of claim 1 wherein the specific operating 
mode is a nap mode. 

17. An apparatus for dynamically changing the size of a 
60 P ower control pool that is used to manage the power 

consumption of memory devices in a memory system, the 
memory devices having active and inactive operating 
modes, the apparatus comprising: 

receive logic to receive a request to change the size of the 
65 power control pool; 

special refresh logic to place the memory devices in the 
inactive operating mode after they are refreshed in a 
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periodic refresh cycle, in response to the request to 33. The apparatus of claim 32 wherein the request to 

change the size of the power control pool; and change the size of the power control pool is initiated by a 

update logic to change the size of the power control pool processor unit. 

to a new size value associated with the request after the 34. The apparatus of claim 32 wherein the request to 

memory devices have been refreshed and placed in the s change the size of the power control pool is initiated by a 

inactive operating mode. s i gna ] generated by a control device. 

18. The apparatus of claim 17 wherein the request to 35. The apparatus of claim 34 wherein the signal gener- 
change the size of the power control pool is initiated by a atcd by thc dcvicc ^ ^ to indicate a thermal 
processor unit. condition that exceeds a predetermined threshold value. 

19. The apparatus of claim 18 wherein the signal gener- „ 3fi ^ apparatus of c]aim 34 mcans for rcceiv . 
ated by the control device is used to indicate a thermal • comnri v e c. 

condition exceeding a predetermined threshold value. ^ 

20. The apparatus of claim 18 wherein the receive logic means for detecting the signal generated by the control 
comprises: device. 

logic to receive the request to change size from the 37. Tne apparatus of claim 32 wherein means for placing 

processor. 15 ^ memory devices in the specific operating mode com- 

21. The apparatus of claim 18 wherein the new size value pnses: 

is supplied by the processor with the request. means for activating the memory devices; and 

22. The apparatus of claim 18 wherein the new size value mcans for refreshing the mcmory deviccs ^ ^ 

^Si 6 "^ ♦ t i • it u • *u , * ™ memory devices have been activated. 

23. The apparatus of claim 17 wherein the request to 20 * 0 t, _ ' . f < - . r , 

u .u • e .u .i i j l 38. The apparatus of claim 32 wherein means for chang- 

change the size of the power control pool is initiated by a tt _ I t t . . & 

signal generated by a control device. * m & the S1Ze te P 0Wer COntro1 P°° l ««P<«* 

24. The apparatus of claim 23 wherein the control device means for updating the power control pool to reflect that 
is a thermal sensor monitoring the thermal condition of the me memory devices have been placed in the specific 
memory devices. 25 operating mode; and 

25. The apparatus of claim 23 wherein the control device means for changing the size of the power control pool to 
is a thermal sensor monitoring the thermal condition of other me new size value associated with the request received, 
devices. 39. An apparatus for dynamically balancing the perfor- 

26. The apparatus of claim 23 wherein the receive logic mance and power consumption levels of a memory system 
comprises: 30 containing multiple dynamic random access memory 

logic to detect the signal generated by the control device. (DRAM) devices, the multiple DRAM devices having at 

27. The apparatus of claim 23 wherein the new size value least two different first and second operating modes, the first 
is maintained in a storage unit. operating mode corresponding to a higher level of perfor- 

28. The apparatus of claim 27 wherein the storage unit mance and power consumption than the second operating 
comprises one or more registers. 35 mode, the apparatus comprising: 

29. The apparatus of claim 17 wherein the special refresh logic to maintain a first list based upon a first number, the 
logic comprises: first list indicating which DRAM devices being in the 

activation logic to place the memory devices in the active first operating mode, the first number indicating the 

operating mode; maximum number of DRAM devices allowed to be in 

logic to refresh the memory devices after they have been 40 the first operating mode; 

activated; and logic to receive a request to change the first number to a 

logic to place the memory devices in the inactive oper- new value; and 

ating mode after they have been refreshed. logic to update the first list and the first number in 

30. The apparatus of claim 17 wherein the update logic ^ response to the request to change the first number, 
comprises: 40. The apparatus of claim 39 wherein the logic to update 

logic to update the power control pool to reflect that the the first list and the first number comprises: 

memory devices have been placed in the inactive logic to request the multiple DRAM devices to be placed 

operating mode; and in the second operating mode after being refreshed; and 

logic to change the size of the power control pool to the 50 logic to reinitialize the first list after the multiple DRAM 

value associated with the request received. devices being placed in the second operating mode. 

31. The apparatus of claim 17 wherein the inactive 41. The apparatus of claim 39 further comprising: 
operating mode is a nap mode. refresh , ogic tQ refresh ^ ^ fc DRAM devices 

32. An apparatus tor dynamically changing the size of a periodically 

power control pool that is used to manage the power 55 42. The apparatus of claim 39 wherein the firs! operaUng 

consumption of memory devices in a memory system, the mode is m active mode and the second operating mode is a 

method comprising: standby mode 

means for receiving a request to change the size of the 43, ^ apparatus of claim 39 wherein the first operating 

power control pool; mode is an active mode and the second operating mode is a 

means for placing the memory devices in a specific $o nap mode. 

operating mode after they are refreshed in a periodic 44. The apparatus of claim 39 wherein the first operating 

refresh cycle; and mode is a standby mode and the second operating mode is 

means for changing the size of the power control pool a nap mode, 

based upon a new size value associated with the request 45. A memory controller for dynamically balancing the 

in response to a signal indicating that the memory 65 performance and power consumption levels of a memory 

devices have been placed in the specific operating system containing multiple dynamic random access memory 

mode. (DRAM) devices, the multiple DRAM devices having at 
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least two different first and second operating modes, the first 
operating mode corresponding to a higher level of perfor- 
mance and power consumption than the second operating 
mode, the memory controller comprising: 

refresh logic to refresh the multiple DRAM devices 5 

periodically; and 
a pool manager to control the performance and power 
consumption levels of the multiple DRAM devices 
comprising: 

logic to maintain a first list based upon a first number, 30 
the first list indicating which DRAM devices being 
in the first operating mode, the first number indicat- 
ing the maximum number of DRAM devices 
allowed to be in the first operating mode; 

logic to receive a request to change the first number to 15 
a new value; and 

logic to update the first list and the first number in 
response to the request to change the first number. 

46. The memory controller of claim 45 wherein the logic 

to update the first list and the first number comprises: 20 
logic to request the multiple DRAM devices to be placed 
in the second operating mode after being refreshed; and 
logic to reinitialize the first list after the multiple DRAM 
devices being placed in the second operating mode. 25 

47. A system for dynamically balancing the performance 
and power consumption levels of a memory system con- 
taining multiple dynamic random access memory (DRAM) 
devices, the multiple DRAM devices having at least two 
different first and second operating modes, the first operating 30 
mode corresponding to a higher level of performance and 
power consumption than the second operating mode, the 
system comprising: 

a processor; and 

a memory controller coupled to the processor, the 35 
memory controller comprising: 
refresh logic to refresh the multiple DRAM devices 

periodically; and 
a pool manager to control the performance and power 

consumption levels of the multiple DRAM devices 40 

comprising: 

logic to maintain a first list based upon a first 
number, the first list indicating which DRAM 
devices being in the first operating mode, the first 
number indicating the maximum number of 45 
DRAM devices allowed to be in the first operating 
mode; 
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logic to receive a request to change the first number 

to a new value; and 
logic to update the first list and the first number in 

response to the request to change the first number. 

48. The system of claim 47 wherein the logic to update the 
first list and the first number comprises: 

logic to request the multiple DRAM devices to be placed 
in the second operating mode after being refreshed; and 

logic to reinitialize the first list after the multiple DRAM 
devices being placed in the second operating mode. 

49. A system for dynamically balancing the performance 
and power consumption levels of a memory system con- 
taining multiple dynamic random access memory (DRAM) 
devices, the multiple DRAM devices having at least two 
different first and second operating modes, the first operating 
mode corresponding to a higher level of performance and 
power consumption than the second operating mode, the 
system comprising: 

a processor to initiate a request to change the number of 
DRAM devices allowed in the first operating mode; 

a thermal control unit to generate a signal indicating a 
thermal condition exceeding a thermal threshold value; 
and 

a memory controller coupled to the processor and the 
thermal control unit, the memory controller compris- 
ing: 

refresh logic to refresh the multiple DRAM devices 

periodically; and 
a pool manager to control the performance and power 

consumption levels of the multiple DRAM devices 

comprising: 

logic to maintain a first list based upon a first 
number, the first list indicating which DRAM 
devices being in the first operating mode, the first 
number indicating the maximum number of 
DRAM devices allowed to be in the first operating 
mode; 

logic to receive a request to change the first number 

to a new value; 
logic to detect the signal indicating the thermal 

condition; and 
logic to update the first list and the first number in 

response to the request from the processor or the 

signal indicating the thermal condition. 
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ABSTRACT 



Disclosed herein is a method and system for calibrating line 
drive currents in systems that generate data signals by 
varying line drive currents and that interpret the data signals 
by comparing them to one or more reference voltages. The 
calibration includes varying the line drive current at a 
transmitting component. At different line drive currents, a 
receiver reference voltage is varied while the transmitting 
component transmits data to a receiving component. At each 
line drive current, the system records the highest and lowest 
receiver reference voltages at which data errors do not occur. 
The system then examines the recorded high and low 
receiver reference voltages to determine a desirable line 
drive current. 

45 Claims, 5 Drawing Sheets 
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BUS LINE CURRENT CALIBRATION around VREF. In the example of FIG. 3, V OIf is 2.5 volts, 

Vref i s 2-2 volts, and V OL is 1.9 volts. This yields a 0.6 volt 

voltage swing: 0.3 volts on either side of VREF. 

TECHNICAL FIELD FIG. 3 shows a circuit for creating a symmetrical voltage 

— . . . , 4 . 4 l t- 5 swing around VREF during a calibration process. This 

This invention relates to bus systems in which line which fc ^ onl ^ the calibr £ tion> utilizes 

voltages are generated by varying line currents and are two differcat bus ^ 60 and 61 cach of which arc simikr 

interpreted with reference to a reference voltage. t0 ^ bus Vmc 2 6 shown in FIG. 2. 

BACKGROUND OF THE INVENTION ^ e ca l*b ration circuit nas current drivers 62 and 63, and 

10 a current control 64 which in this case is an up/down counter. 

FIG. 1 is a block diagram showing a high-speed digital Current drivers 62 and 63 are switched on and off by data 
computer bus system 20. The bus system includes a number control lines (not shown) to create high and low voltage 

of discrete devices 22-24, which communicate over an levels v oh ^ v oi °n the corresponding bus lines. When 

electrical bus 25 at very high speeds. The bus includes a a driver k on, the magnitude of its output current is 

plurality of data transmission lines. 15 determined by the value contained in up/down counter 64. 

This system includes a master device 22 and a plurality of Bus hnes 60 and 61 extend to receiving components and 

slave devices 23-24. The master device 22 initiates and a termination resistor (not shown). Within the transmitting 

controls data exchanges over bus 25. During a data component, however, the high and low output voltages V OIf 

exchange, any one of devices 22-24 can act as either a ^ v ol are sampled for purposes of adjusting the current 

transmitting component or a receiving component. 20 driver outputs to create a symmetric voltage swing. 

Generally, there is only one transmitting component during Specifically, a simple R over R resistive voltage divider 66 

any single data exchange. However, there can be one or a is ^ P laced between a line producing a high logic voltage V OH 

plurality of receiving components during a data exchange. and mother line producing a low logic level V OL . In this 

FIG. 2 illustrates the configuration and operation of a ca ^' * i& ™ ed "»! ^ 60 ^ at the high voltage level, 

single bus line 26 between a transmitting component 27 and 25 ™* current dnver 62 inactive; and bus line 61 is at the low 

a receiving component 28. The bus line is terminated at one * o1 ** c levc • Wlth , curr ? n < dr ™ 63 fi bcm § active ' 

end to a termination voltage V,_ through a termination ^"nore, the resistive divider 66 is configured to pro- 

■ „ , „^ t> Tr,n, m iL„ ^ m * . n r duce an intermediate output voltage V, that is equal to 

impedance R r ™. Transmitting component 27 has a line /T7 x/2 „ \ ~ , 7T /™ . . 

current driver 29, which produces line voltages with speci- ^^^Jl'^TT T ^ V/ - ^ 

fled relationships to a reference voltage VREF. 30 to VREF. A feedback system is used to minimize the 

* „ J . 6 . , voltage difference between V, and VREF. Both V, and 

More speaficalJy, dnver 29 is a current source or sink that y^f m mnmc ^ d to me mputs of a comp arator 68, which 

creates desired voltage drops across termination impedance produces a logic voltage v that is hign when V/ -VREF>0, 

R The current dnver 29 is turned on or otherwise and low when V 7 -VREF<0. V- is then connected to counter 

enabled to produce one logic level voltage, and is turned off 64 ^ e output of ^ [q ^ fa mnntctod to 

or otherwise disabled to produce another logic level voltage. ±e output of current drivers 62 m6 63 

In actual embodiment, the current driver 29 sinks current t. • ,„„,i,„ „ * n ^ • i-. t - 

, uijjj * • i j » Ine circuit works as follows. Dunng calibration, counter 

when enabled, and does not sink or source current when r A - _ U i^ ^ai^ ^ \ a a i a- * 

a- ui a wju a' ui a +u i* i* * . i 64 ls enabled and/or clocked, and repetitively adjusts its 

disabled. When disabled, the line voltaee is approximately * * **u a j j- 5l i ■ i 

1t , l7u u.1 a *u. i- i* a FF lUAAiAi ***' l J r output either up or down depending on the logic value of V^. 

equal to V,_. When enabled, the line voltage is lower than ^ iDcrease / or decreases P the 01 f tput of J mot driver £ 

V because of a voltage drop through termination imped- nj e outpul * mus adjusted * alil me value of C0UQter 

anC f , . , 64 has settled. At this point, V,-VREF-zero— meaning that 
As an example, suppose that V arm is 2.5 volts. When V/ -VREF and that V 0 „ and V oi are symmetric around 
dnver 29 is disabled there is no current through the bus line, VREF. At this point, the value of counter 64 is frozen until 
and the bus line voltage is equal to V,.^, or 2.5 volts. This 45 the nexl ca i ib ration (although minor adjustments might be 
is the high logic level, and is referred to as V OIf . On the other made by temperature control circuits), 
hand when driver 29 is enabled the current through the bus [n most this calibration b per f ormed at system 
ine drops toe lme voltage to a lower value V which in mitialization . Optionally, the calibrated current control value 
this example is 1 .9 volts. \ OL is the low logic leveL (fn)m (he ran be stored j,, a current register 
The voltage difference between W OH and V OL , also 50 ^ used dur i ng normal bus operation to control the mag- 
referred to as a line voltage swing V„,.^, is controlled by the n itu de 0 f \ o value can then ^ sub j ect to temperature 
value of termination resistance V um and the amount of line correction circuits to determine the current control value at 
current l c (which is controlled by the current driver 29). It givca ti mc . Alternatively, the calibration can be per- 
is desirable to limit the line voltage swing as much as formed periodically to account for temperature and voltage 
possible to enable higher bus speeds. If the voltage swing is ss variations. 

too small, however, a receiving component will not be able IdeaUy, both the transmitting component and a receiving 

to reliably distinguish between high and low logic level component have the same value of VREF. In practice, 

vo ages. however, this can be difficult to achieve due to signal line 

FIG. 2 also illustrates how the line voltage is interpreted losses and/or noise. Accordingly, VREF at the receiving 

at receiving component or device 28. Specifically, the 60 component is often somewhat different than VREF at the 

received line voltage V 0 is compared to reference voltage transmitting component. Furthermore, V OM and V OL often 

VREF by a comparator 40. If \ 0 is greater than VREF, the change as they propagate through the signal line, again due 

line voltage represents a high logic level. If V 0 is less than to losses and noise. Thus, the relationship between V ow 

VREF, the line voltage represents a low logic level. v OL and VREF may not be the same at the transmitting 

For this determination to be valid, the transmitting com- 65 component as it is at the receiving component In other 

ponent needs to set its V OH and V OL relative to VREF. words, V,^ might not be symmetric around VREF by the 

Preferably, V OH and V OL are established symmetrically time the signals reach a receiving component. 
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In the bus configuration described above, line losses FIG. 3 is a block diagram illustrating a prior art method 

generally affect V OJL more than V oir At V oi , the voltage is of controlling bus line current. 

being produced by a current through the bus line, so the FIG. 4 is a block diagram of a first embodiment illustrat- 

voltage can be affected along the length of the bus line by ing a bus line calibration method. 

resistive and capacitive loads. At V OHi however, there is no 5 rg. 5 is a flowchart showing methodological operations 

line current, and therefore less opportunity for the voltage to performed in a bus line calibration method. 

be affected alone the length of the bus line. This situation rir ^ <■ . c j 

„. , , , i- i • i , i • , ■ c FIG. 6 is a block diagram of a second embodiment 

affects both toe line voltage swrng and the relaUonsh.p of QIuslrati a bus Une calib T ation me(hod . 
V OL with VREF. & 

The non-symmetry at the receiving component has nega- 10 DETAILED DESCRIPTION 

tive effects. If W OL 11 is higher at the receiving component, The following description sets forth specific embodiments 

the voltage margin from VREF to V OL is decreased. When 0 f a bus driver calibration method and circuits having 

V OL is lower at the receiving component, low-side margin is elements recited in the appended claims. The embodiment is 

increased, but the higher V swirtg would cause more described with specificity in order to meet statutory require- 

reflections, which could degrade the high-side margin dur- ments. However, the description itself is not intended to 

ing a subsequent data transfer cycle limit the scope of this patent. Rather, the inventors have 

This issue has been addressed by introducing a degree of contemplated that the claimed invention might also be 

asymmetry at the transmitting component in order to provide embodied in other ways, to include different elements or 

symmetry at the receiving component: the current drivers at combinations of elements similar to the ones described in 

the transmitting component are adjusted to achieve voltage 20 this document, in conjunction with other present or future 

symmetry at the receiving component. The amount of asym- technologies. 

me try at the transmitting component is referred to as the FIG. 4 shows pertinent parts of a data communications 

overdrive factor (ODF). system 100 that can be used to implement a method of 

A desired asymmetry at the transmitting component can 2j calibrating or finding a desirable line drive current. The 

be created by varying the ratio of voltage divider 66. Thus, system allows such calibration during device operation. The 

instead of producing a signal V 7 that is 50% of the way from calibration is usually performed at system startup or initial- 

V Gi to V 0 hi the resistors can be chosen to implement any ization. Through actual testing during the calibration 

other percentage. This creates asymmetry at the transmitting procedure, asymmetry values are determined for different 

component to correct for any asymmetry that would other- 3Q transmitting components. Furthermore, each transmitting 

wise be present at the receiving component. component can find a different asymmetry value for every 

In actual embodiment, the ratio of voltage divider 66 has possible receiving component. This allows an optimal line 
been controlled by a symmetry control register. Different current to be used for each different receiver, 
values can be loaded into the symmetry control register to Th e overall system is of a type that interprets data signals 
create different degrees of asymmetry at the transmitting 3S bv comparing them to reference voltages. Signals are trans- 
component. Symmetry control values can be stored for a mitted over a plurality of data signaling lines, also referred 
plurality of different receivers, and used when transmitting to as Dus lines. Each bus line is terminated to a termination 
to those receivers. This accounts for variations in conditions voltage V Mrm , through a termination resistance R femi . The 
at different receivers. data signals comprise line voltages that are produced by Une 

In some such circuits, the value of counter 64 is stored 40 drive currents through R rerm . The line voltages are compared 

after completion of the calibration process, and loaded into to the reference voltages to determine whether the voltages 

a current control register during actual operation. Aplurality represent high or low logic values. 

of values can be stored, corresponding to different receiving * V P C of bus system is used in various environments, 
components. The current control register is reloaded for One of its most common uses is for high-speed data corn- 
communication with different receiving components. 45 munications busses between microprocessors and peripheral 
Tne desired line current and corresponding divider per. devices SUC \ as KgMpecd memory devices. Such bus 
centage or ratio are determined during system design-prior P temS are also ^ m memorv subsystems, 
to manufacture of the transmitting component or prior to between memor y devices and memorv device Rollers, 
manufacture of a circuit that utilizes the transmitting com- For P ur P 0Ses of discussion, the illustration of FIG. 4 has 
ponent. The determination is based on testing and/or 50 been gready simplified, and shows only parts of the trans- 
simulating, and choosing voltage divider ratios that are nutting and receiving components that might be used in a 
predicted to work with the different receivers in light of the calibration process. 

actual circuit layout. In some cases, the transmitting com- FIG - 4 shows a single transmitting component 102 and a 

ponent includes logic for predicting required asymmetry single receiving component 104. A data bus fine 106 extends 

values based on known system parameters such as distances 55 between transmitting component 102 and receiving compo- 

between components. nent * n practice, there are a plurality of bus lines, and 

Hie inventors, however, have discovered and developed a each bus line mi > / ht be t0 one or morc transmitting 

way to dynamically determine appropriate line drive cur- com P onents ««Vor one or more receiving components, 
rents at system initialization, based on tested characteristics Wllhin Emitting component 102, a current driver 108 

of the circuits themselves. 60 generates a current l 0 though bus lme 106. The current 

driver is responsive to a logic level data signal 110 to switch 

BRIEF DESCRIPTION OF THE DRAWINGS the current driver on or off, generating a signal voltage V 0 . 

A high signal voltage is referred to as V 0/f) and is the result 

FIG. 1 is a block diagram of a high-speed digital computer 0 f switching the driver off. A low signal voltage is referred 

bus system in accordance with the prior art. 6S to as V OL , and is the result of switching the driver on. V OH 

FIG. 2 is a block diagram illustrating a bus line transmitter and V OL are usually used to represent high and low binary 

and receiver in accordance with the prior art. logic levels "1" and "0". 
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Receiving component 104 has a reference voltage VREF^ other specified value. Alternatively, the predefined criteria 

that can be independent of any voltage in transmitting might specify that the desired drive current IJi] is obtained 

component 102. VREF A is generated by a digital-to-analog when V JKfin the difference between MVREF^JTJ and 

converter (DAC) 111. The DAC can be integrated with MVREF AO [i], is at its greatest. This relationship produces 

receiving component 104 or it can be separate from receiv- 5 the highest useful voltage margin at V 0i . Another criteria 

ing component 104. might specify the drive current I 0 [i] corresponding to the 

Receiver 104 includes a voltage comparator 112 that pair of MVREF^ 0 [i] and MVREF^i] whose average 

compares two analog voltage inputs and produces a binary (MVREF^ 0 [i]-MVREF w Ji])/2) is closest to the VREF* 

voltage signal indicating which of the two input voltages is value that will De used during normal bus operation. This 

greater in magnitude. A comparator such as this is associated 10 ensures that V OL and V 0ff are symmetrical around VREF^ 

with each bus line to evaluate whether a logic signal during normal bus operation. 

represents a high or low logic voltage level. Operation 132 comprises setting current driver 108 to the 

One input of comparator 112 receives receiver reference drive current y i] corresponding to the pair of receiver 

voltage VREF«. The other input of comparator 112 is reference voltages MVREF i0 [i] and MVREF^i] that were 

connected to bus line 106. In response to these two inputs, 15 found in operation 130. This drive current is used on all 

the comparator generates a logic level signal or voltage V^, of the data signaling lines originating from transmitting 

representing a data bit or other information that has been component 102. 

transmitted from transmitting component 102. The value of FIG. 6 shows a different embodiment of a system in which 

V D is dependent on whether V 0 is greater or less than V OL and V OH are calibrated to provide symmetry at a 

VREF^. 20 receiving component. FIG. 6 shows only the current control 

FIG. 5 illustrates a method of calibrating current driver and calibration circuitry in a transmitting component 198 

108 so that the resulting voltage swing is symmetrical and the comparison circuitry of a receiving component 199. 

around VREF^. Such a calibration is performed during The current control and calibration circuitry of transmit- 

system startup or during initialization of the transmitting ting component 198 uses two different bus lines 202 and 

and/or receiving components. 25 203. A variable voltage divider 204 is located between the 

The method comprises varying the line drive current two bus lines. Divider 204 divides the voltage differential 
I G — sequentially setting \ 0 to each of a range of possible between a high line voltage V OH and low line voltage V OL 
values l a . This is accomplished by sequentially configuring to obtain an intermediate voltage V DJV that is a dynamically 
the transmitting component's current driver 108 to supply programmable fraction between the high and low line volt- 
line drive current 1^ at a plurality of discrete values I o [0] ages V OH and V OL . The output voltage of variable 
through I 0 [n], as indicated in FIG. 5 by blocks 120 and 128. voltage divider 204 is controlled by a factor x stored in a 

Blocks 122 and 126 indicate an operation of varying the symmetry control register 224: V^^V^+x (V 0i/ -V 0i ), 

receiver reference voltage VREF^ through a predetermined where factor x is a value between 0 and 1. 

sequence of different available voltages. This operation is 35 The output V OIV of the voltage divider is provided to a 

repeated for every value of I 0 . comparator 206, along with a transmitter reference voltage 

Operation 124 is performed for each VREF^ value, and VREFp. VREF r is generated by a DAC 207. The output 

comprises transmitting data from transmitting component feedback voltage of the comparator is connected to 

102 to receiving component 104 to find high and low control a current controller. Specifically, drives the 

receiver reference voltages at which data errors do not occur. 40 up/down count of a current control counter 208. The value 

More specifically, operations 122, 124, and 126 comprise °f counter 208 is received by current drivers 212 (one 

setting VREFjj to some intermediate value and then varying associated with each bus line 202 and 203) to set or control 

VREF^ downward. At each value of VREFr, the transmit- the output line current I 0 , and, consequently, the line voltage 

ting component sends worst -case test data and then deter- Vol- 

mines whether or not there was an error in receiving the data 45 Up/down counter 208 is configured to control current 

at the receiving component. Initially, at intermediate drivers 212 only during a calibration operation. In normal 

voltages, errors are unlikely. However, as VREFr is varied bus operation, the current drivers' output \ 0 is controlled 

further downward, the margin between VREFj, and \ OL will directly, by a current control register 213. 

become small enough to cause data errors. This establishes During normal bus operation, the current drivers are 

the low receiver reference voltage MYREF^ — the lowest 5 0 independently enabled and disabled in accordance with data 

VREFfl at which data errors do not occur. A similar signals (not shown) that indicate the data values that are to 

procedure, varying VREF^ in the upward direction, estab- be transmitted. When enabled, a bus driver produces a line 

lishes MVREF^, — the highest VREFj, at which data errors current l Q according to the value held in counter 208 or 

do not occur. current control register 213, and a corresponding low line 

MVREF LO and MVREF W/ are noted or recorded in arrays 55 voltage V OL . When disabled, a bus driver produces no 
MVREF to [i] and MVREF^Ji], corresponding to each drive current and a corresponding high line voltage V 07f) regard- 
current value I 0 [i]. less of the value of counter 208 or current control register 

An operation 130 comprises examining or evaluating the 213. 

noted high and low receiver reference voltages MVREF i<? [i] During normal bus operation, current control register 213 

and MVREF^i] corresponding to different drive currents 60 remains at a fixed value except for changes to account for 

loPL to determine a desirable line drive current. More temperature and power supply variations. Voltage divider 

specifically, this operation comprises finding a pair of 204, comparator 206, and symmetry control register 224 are 

receiver reference voltages MVREF LO [i] and MVREF^Ji], not used during normal operation. 

for each value of i through n, that meet p re-specified criteria A calibration procedure is performed to determine appro - 

or are within specified parameters. Such predefined criteria, 65 priate values for current control register 224. During 

for example, might require that MVREF^i] is less than calibration, current drivers 212 are controlled by the output 

some specified value and that MVREF w Ji] is above some of up/down counter 208, rather than by current control 
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register 213. The calibration process is performed at system component, a method of finding a desirable line drive 

startup or initialization, between a transmitter and every one current comprising: 

of its possible receivers. During this process, bus line 202 is at me transmitting component, varying the line drive 

set to its high voltage V 0// by disabling the associated current* 

current driver 212. Bus line 203 is set to its low voltage V 0/ c t ..„, \ . . t . - 

by enabling the associated current driver 212. at differen lme drive currents, varytng a receiver refer- 

V t . . frir c i.j* i¥ ence voltage while the transmitting component trans- 

The calibration circuit of FIG. 6 regulates drive current \ Q , . , ° . * A £ , , . 

to maintain W DTV approximately equal to Tnus, V DI £ mits data t0 the receiving component, to find high and 

Vxe* and V^V^+x (V 0/r -V^). If x-O^then, V^is low rcceiver reference volta e es at wtuch dala errors do 

halfway or 50% of the way between W OL and V OH . If not occur > 

x=0.25, is 25% of the way from V OL to V OH . Thus, noting the high and low receiver reference voltages cor- 
factor x represents the location of as a fraction or responding to the different respective line drive cur- 
percentage of the voltage range between V OL and V oyf . rents; and 

In each receiving component 199, one of the bus lines examining the noted high and low receiver reference 

202/203 is connected to one input of a comparator 241. The 15 voltages to find the desirable line drive current, 

other input of the comparator receives VREF^. VREF r and 2- A method as recited in claim 1 wherein the examining 

VREF^ are controlled independently for the transmitting comprises: 

component and the receiving component. Thus, while one determining the line drive current at which the noted high 

DAC 207 generates VREF r for transmitter 198, a different and low receiver reference voltages are within specified 

programmable DAC 218 generates VREF^ for receiver 199. 2Q parameters. 

In FIG. 6, a separate DAC 218 is shown for every receiving 3. a method as recited in claim 1 wherein the examining 

component 199. However, some embodiments might use a comprises: 

single DAC to supply a common VREF* to every receiving determining the line drive current at which the noted high 

component. ^ j QW rece j ver reference voltages have a specified 

The method of FIG. 5 is used in conjunction with the 25 relationship with each other, 

circuit of FIG. 6 to calibrate \ 0 . In order to vary I 0 during 4. A method as recited in claim 1 wherein the examining 

step 120, the factor x in symmetry control register 224 is comprises: 

cycled through its available values. Step 130 comprises determining the line drive current at which the noted high 

determining the value of symmetry control register 224 that receiver referellce voltage is reater than a ^ . 

was used to produce the desired values of MVREF io and 30 etef and me noted low reccivcr refercnce voltage is less 

MVREF™, and reloading this value into the symmetry than a second parameter . 

control register 224 for future voltage/temperature calibra- 5 . Amethod as recited in claim 1 wherein the examining 

tions. Step 132 comprises copying the counter value to the comprises- 

current control register 213 for subsequent use in normal , , , • A ........ 

*• c »u u 1* determining the line drive current at which the difference 

operation ot the bus lines. « , A *», . , . • , , . . c 

* . . . - fi , between the noted high and low receiver reference 

During normal operation, voltage/temperature calibra- voltages is greatest, 

tions can be performed by continuously varying the value of < A m T 1 . < j • 1 ■ 1 u * *u 

. i • * -i*. t . -i . i ,• 6. A method as recited in claim 1 wherein the examining 

current control register 213. In the described embodiment, rises* 

however, a voltage/temperature calibration operation is per- , , 

formed every 10 milliseconds using the calibration circuitry 40 det ™ n § ^ e ^ ^nve current at which the average of 

already described. This operation involves activating volt- the noted m S h ^ J ow receiver reference voltages is 

age divider 204 and up/down counter 208 to control current approximately equal to the receiver reference voltage 

drivers 212. Using the symmetry value found in step 130, the , ™ ed durm § ^rmal bus line operation. 

up/down counter is allowed to settle to a new value that 7. Amethod as recited in claim 1, further comprising: 

maintains the originally determined degree of asymmetry 45 the desirable line current on said one or more data 

with regard to VREF^ This new value is then loaded into signaling lines. 

current control register 213 for subsequent normal operation 8 - A method as recited in claim 1, further comprising: 

of the bus lines. finding and storing desirable line drive currents for a 

The circuits and methods described above allow trans- plurality of different receiving components, 

mitter drive currents to be optimized for each of a plurality 50 9 * A method as rccited in claim further comprising: 

of receivers. Furthermore, the calibration is performed finding and storing desirable line drive currents for a 

dynamically, for actual pairs of transmitters and receivers. plurality of different receiving components; and 

This method is more likely to produce optimum drive using the stored desirable Ike drive currents with different 

currents than the prior art method of predicting asymmetry receiving components. 

values based on assumptions made during system design. 55 10. In a system containing one or more data signaling 

Although details of specific implementations and embodi- unes between a transmitting component and a receiving 

ments are described above, such details are intended to component, wherein an individual signal line is driven by a 

satisfy statutory disclosure obligations rather than to limit une drive current to produce high and low line voltages 

the scope of the following claims. Thus, the invention as relative to a transmitter reference voltage, the high and low 

defined by the claims is not limited to the specific features 60 line voltages being distinguished with reference to a receiver 

described above. Rather, the invention is claimed in any of reference voltage; a method of finding a desirable line drive 

its forms or modifications that fall within the proper scope current comprising: 

of the appended claims, appropriately interpreted in accor- at the transmitting component, enabling or disabling a 

dance with the doctrine of equivalents. desirable line drive current to produce high and low 

What is claimed is: 65 hue voltages during data transfer; 

1. In a system containing one or more data signaling lines calibrating the line drive current at system initialization, 

between a transmitting component and a receiving the calibrating comprising: 
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varying the line drive current to vary at least one of the 
high and low line voltages in relation to the trans- 
mitter reference voltage; 

at different line drive currents, varying the receiver 
reference voltage while the transmitting component 
transmits data to the receiving component, to find 
high and low receiver reference voltages at which 
data errors do not occur; 

noting the high and low receiver reference voltages 
corresponding to the different line drive currents; and 

comparing the noted high and low receiver reference 
voltages at each line drive current to find the desir- 
able line drive current. 

11. A method as recited in claim 10 wherein the exam- 
ining comprises: 

determining the line drive current at which the noted high 
and low receiver reference voltages are within specified 
parameters, 

12. A method as recited in claim 10 wherein the exam- 
ining comprises: 

determining the line drive current at which the noted high 
and low receiver reference voltages have a specified 
relationship with each other. 

13. A method as recited in claim 10 wherein the exam- 
ining comprises: 

determining the line drive current at which the noted high 
receiver reference voltage is greater than a first param- 
eter and the noted low receiver reference voltage is less 
than a second parameter. 

14. A method as recited in claim 10 wherein the exam- 
ining comprises: 

determining the line drive current at which the difference 
between the noted high and low receiver reference 
voltages is greatest. 

15. A method as recited in claim 10 wherein the exam- 
ining comprises: 

determining the line drive current at which the average of 
the noted high and low receiver reference voltages is 
approximately equal to the receiver reference voltage 
used during normal bus line operation. 

16. A method as recited in claim 10, further comprising: 
using the desirable line current on said one or more data 

signaling lines. 

17. A method as recited in claim 10, further comprising: 
finding and storing desirable line drive currents for a 

plurality of different receiving components. 

18. A method as recited in claim 10, further comprising: 
finding and storing desirable line drive currents for a 

plurality of different receiving components; and 
using the stored desirable line drive currents with different 
receiving components. 

19. In a data communications system of a type that 
generates and interprets data signals by comparing them to 
one or more reference voltages, the data signals comprising 
line voltages that are produced by line drive currents; a 
method comprising: 

dividing a voltage differential between a high line voltage 
and a low line voltage to obtain an intermediate voltage 
that is a dynamically programmable fraction between 
the high and low line voltages; 

regulating a line drive current produced by a transmitting 
component to maintain the intermediate voltage 
approximately equal to a transmitter reference voltage; 

varying the programmable fraction to vary the regulated 
line drive current; 
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at different fractions, varying a receiver reference voltage 
while the transmitting component transmits data to a 
receiving component, to find high and low receiver 
reference voltages at which data errors do not occur; 

noting the high and low receiver reference voltages cor- 
responding to different fractions; and 

comparing the noted high and low receiver reference 
voltages at each line drive current to find a fraction that 
produces a desirable line drive current. 

20. A method as recited in claim 19 wherein the exam- 
ining comprises: 

determining the fraction at which the noted high and low 
receiver reference voltages are within specified param- 
eters. 

21. A method as recited in claim 19 wherein the exam- 
ining comprises: 

determining the fraction at which the noted high and low 
receiver reference voltages have a specified relation- 
ship with each other. 

22. A method as recited in claim 19 wherein the exam- 
ining comprises: 

determining the fraction at which the noted high receiver 
reference voltage is greater than a first parameter and 
the noted low receiver reference voltage is less than a 
second parameter. 

23. A method as recited in claim 19 wherein the exam- 
ining comprises: 

determining the fraction at which the difference between 
the noted high and low receiver reference voltages is 
greatest. 

24. A method as recited in claim 19 wherein the exam- 
ining comprises: 

determining the fraction at which the average of the noted 
high and low receiver reference voltages is approxi- 
mately equal to the receiver reference voltage used 
during normal bus line operation. 

25. A method as recited in claim 19, further comprising: 
using the desirable line drive current on said one or more 

data signaling lines. 

26. A method as recited in claim 19, further comprising: 
finding and storing desirable line drive currents for a 

plurality of different receiving components. 

27. A method as recited in claim 19, further comprising: 
finding and storing desirable line drive currents for a 

plurality of different receiving components; and 
using the stored desirable line drive currents with different 

receiving components. 
28 . A data communications system of a type that generates 
and interprets data signals by comparing them to one or 
more reference voltages, comprising: 
a transmitting component and a receiving component; 
a data transmission line between the transmitting compo- 
nent and the receiving component; 
a line current driver in the transmitting component that 
regulates line drive current through the data transmis- 
sion line to produce high and low line voltages on the 
data transmission line; 
control logic that performs actions comprising: 
varying the regulated drive current; 
at different drive currents, varying a receiver reference 
voltage while the transmitting component transmits 
data to the receiving component, to find highest and 
lowest receiver reference voltages at which data 
errors do not occur; 
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noting the high and low receiver reference voltages 
corresponding to different drive currents; 

examining the noted high and low receiver reference 
voltages to find a drive current that produce a desir- 
able drive current. 5 

29. A data communications system as recited in claim 28 
wherein the examining comprises: 

determining the drive current at which the noted high and 
low receiver reference voltages are within specified 
parameters. 10 

30. A data communications system as recited in claim 28 
wherein the examining comprises: 

determining the drive current at which the noted high and 
low receiver reference voltages have a specified rela- 
tionship with each other. 15 

31. A data communications system as recited in claim 28 
wherein the examining comprises: 

determining the drive current at which the noted high 
receiver reference voltage is greater than a first param- 2Q 
eter and the noted low receiver reference voltage is less 
than a second parameter. 

32. A data communications system as recited in claim 28 
wherein the examining comprises: 

determining the drive current at which the difference 2 5 
between the noted high and low receiver reference 
voltages is greatest. 

33. A data communications system as recited in claim 28 
wherein the examining comprises: 

determining the drive current at which the average of the 30 
noted high and low receiver reference voltages is 
approximately equal to the receiver reference voltage 
used during normal bus line operation. 

34. A data communications system as recited in claim 28, 
the control logic performing further actions comprising: 35 

using the desirable current on said one or more data 
signaling lines. 

35. A data communications system as recited in claim 28, 
the control logic performing further actions comprising: 

finding and storing desirable drive currents for a plurality 40 
of different receiving components. 

36. A data communications system as recited in claim 28, 
the control logic performing further actions comprising: 

finding and storing desirable drive currents for a plurality 45 

of different receiving components; and 
using the stored desirable drive currents with different 

receiving components. 

37. A data communications system of a type that generates 
and interprets data signals by comparing them to one or 50 
more reference voltages, comprising: 

a transmitting component and a receiving component; 

a data transmission line between the transmitting compo- 
nent and the receiving component; 

a line current driver in the transmitting component that 55 
regulates line drive current through the data transmis- 
sion line to produce high and low line voltages on the 
data transmission line; 

a voltage divider in the transmitting component that 
produces an intermediate voltage that is a variable 
fraction between the high and low line voltages; 
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wherein the line current driver establishes the regulated 
current so that the intermediate voltage is approxi- 
mately equal to a transmitter reference voltage; 

control logic that performs actions comprising: 

varying the variable fraction to vary the regulated drive 
current; 

at different fractions, varying a receiver reference volt- 
age while the transmitting component transmits data 
to the receiving component, to find high and low 
receiver reference voltages at which data errors do 
not occur; 

noting the high and low receiver reference voltages 
corresponding to different fractions; and 

comparing the noted high and low receiver reference 
voltages at each line drive current to find a fraction 
that produces a desirable line drive current. 

38. A data communications system as recited in claim 37 
wherein the examining comprises: 

determining the fraction at which the noted high and low 
receiver reference voltages are within specified param- 
eters. 

39. A data communications system as recited in claim 37 
wherein the examining comprises: 

determining the fraction at which the noted high and low 
receiver reference voltages have a specified relation- 
ship with each other. 

40. A data communications system as recited in claim 37 
wherein the examining comprises: 

determining the fraction at which the noted high receiver 
reference voltage is greater than a first parameter and 
the noted low receiver reference voltage is less than a 
second parameter. 

41. A data communications system as recited in claim 37 
wherein the examining comprises: 

determining the fraction at which the difference between 
the noted high and low receiver reference voltages is 
greatest. 

42. A data communications system as recited in claim 37 
wherein the examining comprises: 

determining the fraction at which the average of the noted 
high and low receiver reference voltages is approxi- 
mately equal to the receiver reference voltage used 
during normal bus line operation. 

43. A data communications system as recited in claim 37, 
the control logic performing further actions comprising: 

using the desirable line drive current on said one or more 
data signaling lines. 

44. A data communications system as recited in claim 37, 
the control logic performing further actions comprising: 

finding and storing desirable line drive currents for a 
plurality of different receiving components. 

45. A data communications system as recited in claim 37, 
the control logic performing further actions comprising: 

finding and storing desirable line drive currents for a 
plurality of different receiving components; and 

using the stored desirable line drive currents with different 
receiving components. 

***** 
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METHOD AND APPARATUS FOR to contend with a changing memory specification. A flexible 

CONFIGURING A MEMORY DEVICE AND A memory initialization technique could advantageously be 

MEMORY CHANNEL USING utilized in a Direct Rambus™ bus or in any other memory 

CONFIGURATION SPACE REGISTERS system requiring significant initialization or configuration. 

s 



RELATED APPLICATIONS 

This application is related to an application Sen No. 
09/186,046, entitled "A Method And Apparatus For Level- 
izing Transfer Delays For A Channel Of Devices Such As 
Memory Devices In A Memory Subsystem," application Ser. 10 
No. 09/186,051, entitled "A Method And Apparatus For 
Configuring And Initializing A Memory Device And A 
Memory Channel," and application Ser. No. 09/186,049, 
entitled "A Method And Apparatus For Restoring A Memory 
Device Channel When Exiting A Low Power State/' all of 1S 
which are filed concurrently herewith. 

BACKGROUND 

1 . Field of the Invention 2 0 
The present disclosure pertains to the field of data pro- 
cessing systems. More particularly, the present disclosure 
pertains to initializing or configuring a memory devices in a 
memory channel. 

2. Description of Related Art 25 
Memory devices and memory subsystems typically have 

certain initialization steps and/or register values that need to 
be programmed prior to normal operation. Recommended 
steps and values are often detailed in a memory specification 
provided to system designers who design other system 30 
hardware interfacing with the memory devices. 
Unfortunately, memory specifications may change, and new 
initialization sequences and/or register values may be desir- 
able. 

To implement a new system compliant with a revised 
specification, expensive hardware changes may be required. 
Additionally, if more optimal initialization values or 
sequences are later discovered, they may not be imple- 
mented due to the high overhead of making hardware 4Q 
changes. Present systems do not provide a flexible memory 
initialization technique that may advantageously allow ini- 
tialization sequences to be altered or optimized after hard- 
ware components have been completed. 

One channel (i.e., a bus configuration) which requires a 45 
significant amount of initialization prior to proper operation 
is a Rambus™ Direct Rambus Dynamic Random Access 
Memory Channel (a Direct RDRAM™ Channel). This chan- 
nel is described in detail in documentation available from 
Rambus Corporation of Mountain View, Calif. RDRAM 50 
memories and memory controllers interfacing with a Ram- 
bus channel have various registers that need to be pro- 
grammed during the initialization process. 

One method of initializing a direct RDRAM channel is 
described in the RMC.dl Data Sheet, which describes a 55 
Direct Rambus™ Memory Controller (RMC). The RMC, 
however, utilizes an "Init Block" as a part of an application 
specific integrated circuit (ASIC) to implement initialization 
procedures (see FIG. 7, p. 16 and p. 72, et seq.). The Init 
Block is simply activated using two init signals and there- $ 0 
after performs a routine hard-wired into the Init Block ASIC 
hardware. 

Thus, the prior art in general may not provide an adequate 
method and apparatus for configuring a set of memory 
devices. A hard- wired solution such as the RMC ASIC 65 
inherently lacks the flexibility to allow rapid alteration of 
initialization sequences in order to optimize initialization or 



SUMMARY 

A method and apparatus for configuring memory devices 
is disclosed. A disclosed bus controller includes a storage 
location and a control circuit. The control circuit is coupled 
to perform an initialization operation when a value indicat- 
ing that initialization operation is stored in the storage 
location. The initialization operation is selected from one of 
a set of initialization operations that the control circuit is 
capable of performing. 

BRIEF DESCRIPTION OF THE FIGURES 

The present invention is illustrated by way of example 
and not limitation in the figures of the accompanying 
drawings. 

FIG. 1 illustrates one embodiment of a system using 
configuration registers in a memory controller to designate 
initialization operations for memory initialization. 

FIG. 2 illustrates a flow diagram of programming and 
executing initialization operations in one embodiment of the 
system of FIG. 1. 

FIG. 3 illustrates one embodiment of a memory control 
hub that performs memory initialization according to values 
loaded into control and data registers. 

FIG. 4 illustrates a flow diagram for a memory device 
core initialization operation. 

FIG. 5 illustrates one embodiment of a system imple- 
menting an initialization flow shown in FIGS. 6-9. 

FIG. 6 illustrates a flow diagram of one embodiment of an 
overall initialization sequence for the memory subsystem of 
the system shown in FIG. 5. 

FIG. 7 illustrates one embodiment of a serial device 
identification process. 

FIG. 8 A illustrates one embodiment of a first portion of a 
group device identification process. 

FIG. 8B illustrates one embodiment of a group device 
assignment process (e.g., block 820 in FIG. 8A). 

FIG. 8C illustrates one embodiment of a second portion of 
the group identification process from FIG. 8A. 

FIG. 9 illustrates one embodiment of a memory device 
core initialization process. 

FIG. 10 illustrates one embodiment of the process of 
returning from a suspend-to- RAM power management state. 

DETAILED DESCRIPTION 

The following description provides a method and appa- 
ratus for initializing a memory device and a memory chan- 
nel. In the following description, numerous specific details 
such as register names, memory types, bus protocols, spe- 
cific types of components, and logic partitioning and inte- 
gration choices are set forth in order to provide a more 
thorough understanding of the present invention. It will be 
appreciated, however, by one skilled in the art that the 
invention may be practiced without such specific details. In 
other instances, control structures and gate level circuits 
have not been shown in detail in order not to obscure the 
invention. Those of ordinary skill in the art, with the 
included descriptions, will be able to implement the neces- 
sary logic circuits without undue experimentation. 

Using the presently disclosed techniques, efficient and 
flexible memory initialization may be performed. Control 
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and data registers may be programmed, thereby causing a As indicated in block 210, data (if any) for the particular 

memory control hub (MCH) to perform initialization opera- initialization operation is stored in the data register 114, and 

tions (lOPs) according the values loaded in the registers. the initialization operand itself with other control informa- 

Since the registers may be programmed by software such as tion is stored in the control register 112. In some 

a basic input/output system (BIOS), the initialization may be 5 embodiments, the BIOS may perform this function by 

altered with relative ease. writing to peripheral component interconnect (PCI) configu- 

FIG. 1 illustrates one embodiment of a system utilizing ration registers. Alternatively, other registers may be used, or 

registers to perform memory initialization. The system general purpose memory locations either within or without 

includes a processor 195 and a memory subsystem 104 that me MCH ma y be the control register. In fact, the control 

are coupled to a memory control hub (MCH) 100. Also ™ register may be any storage location accessible to the MCH 

coupled to the MCH 100 is a secondary bus 180 having P rior to memory initialization that is capable of storing 

coupled thereto an input device 190 and a non-volatile sufficient bits for IO Ps and any other needed control infor- 

memory 185 containing BIOS routines. In some mation. 

embodiments, either or both of the non-volatile memory 185 The initialization operation may commence automatically 

and the input device 190 may be coupled to the MCH 100 15 when the proper initialization operation and/or control infor- 

by a second control hub (not shown). mation are programmed into the control register 112. For 

In the illustrated embodiment, the memory subsystem 104 example, the execution of the initialization operation indi- 

includes three memory modules 160, 170, and 175 coupled cated in block 215 may be accomplished by setting an 

to the MCH 100 via a serial bus 142 and a memory bus 132 initiate initialization operation (IIO) bit when the initializa- 

(also referred to as a channel). Each memory module may 20 uon operand is loaded into the control register 112. The IIO 

contain a set of individual memory devices. For example, mt may be a field of the control register 112 so the same 

the memory module 160 includes at least memory devices register write transaction may set the IIO bit and provide the 
160, 161, and 168. In one embodiment, the memory devices 

160, 161, and 168 are Rambus DRAMs (RDRAMs), the Completion of the initialization operation may be signaled 

memory modules are Rambus In-line Memory Modules 25 in any manner sufficient to alert or inform the BIOS that the 

(RIMMs), and the channel operates according to protocols initialization operation is complete. For example, the MCH 

defined for RIMMs and RDRAMs. may automatically clear the IIO bit when the initialization 

The MCH 100 includes a control register 112 and a data operation completes. If the BIOS polls the IIO bit, it may 

register 114 which may be used for initialization purposes. determine when the initialization operation completes as 

An initialization control circuit 120 executes initialization indicated in block 220. If the initialization operation has not 

operands (lOPs) which are programmed into the control completed, the BIOS may continue polling the IIO bit. If the 

register 112. The control register 112 typically includes other initialization operation has completed, the BIOS may select 

fields to specify information about initialization operations, the next initialization operation in the initialization sequence 

and some of the operations specified by the IOPs involve ^ in block 205. 

data exchange with devices in the memory subsystem (e.g., The input device 190 may either accept program instruc- 

writing and reading of memory device control registers or tions from a computer storage device 192 (e.g., an optical or 

otherwise generating control signals). magnetic disk or other storage device) or from a network or 

A serial interface circuit 140 generates serial command communications interface 194. BIOS code (i.e., computer 

and data sequences on the serial bus 142. Some of the 40 instructions) causing the system to implement the disclosed 

commands executed by the initialization control circuit 120 techniques may be programmed into the non-volatile 

send commands and/or data to the memory subsystem via memory 185 in several ways. The BIOS may be pro- 

the serial bus 142. Control registers, including device reg- grammed when the system is manufactured or may be later 

isters for identification numbers, may be read and written via delivered via a computer readable medium through the input 

the serial interface circuit 140, 45 device 190. 

A memory interface circuit 130 translates memory data to In cases where the BIOS is later delivered, the instructions 

and from data packets which are exchanged with the may be delivered via a computer readable medium. With an 

memory subsystem. In one embodiment, the memory inter- appropriate interface device 190, either an electronic signal 

face circuit is a Rambus ASIC Cell (RAC) functioning or a tangible carrier is a computer readable medium. For 

substantially as described in the "Direct RAC Data Sheet" 50 example, the computer storage device 192 is a computer 

available from Rambus Corporation of Mountain View, readable medium in one embodiment. A carrier wave 196 

Calif. Briefly, the RAC converts the Rambus Signal Level carrying the computer instruction is a computer readable 

(RSL) signals on the channel (bus 132) to signals which can medium in another embodiment. The carrier wave 196 may 

be processed by other portions of the MCH 100. Similarly, be modulated or otherwise manipulated to contain instruc- 

the RAC converts the memory controller signals to RSL 55 tions that can be decoded by the input device 190 using 

signal which can be processed by memory devices on the known or otherwise available communication techniques. In 

Rambus channel. either case, the computer instructions may be delivered via 

A sequence of initialization events for the system of FIG. a computer readable medium. 
1 is illustrated in FIG. 2. As the system is reset or turned on, FIG. 3 illustrates additional details of a memory controller 
the BIOS typically performs various initialization opera- 60 hub (MCH) 300. Details of specific register names, 
tions. In block 200, the BIOS reaches the memory configu- locations, sizes, field definitions, and initialization opera- 
ration portion. Depending on the type of memory and the tions are given for one embodiment below. Other embodi- 
intended mode of usage, initialization operations will be ments will be apparent to those of skill in the art. Several of 
selected (block 205) by the BIOS in a particular sequence. the operations below invoke specific commands defined by 
More details of one embodiment of an initialization 65 Rambus in the 64/72-Mbit Data Sheet and the Direct RAC 
sequence for a system utilizing RDRAMs are discussed with data sheet. These defined operations are operations that the 
respect to FIGS. 5-9. Rambus RAC itself sends to RDRAMs when appropriate 
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control signals are sent to the RAC. As detailed below, this Register is at address offset 94-9 6h in PCI configuration 
embodiment of the MCH 300 invokes known RAC com- space, the default value is OOOOOOh (24 bits), and the register 
mands by previously unavailable hardware and in new t s a re ad/write register. The fields of the RICM register for 
methods or sequences. mis embodiment are set forth in Table 2. 

In this exemplary embodiment, the MCH 300 includes a s 
RAC 330 and a serial interface 340. The serial interface 340 
uses clock (SCK), serial frame (CMD), and bi-directional 
serial I/O pins (SIO0 and SIOl) to read and write RDRAM 
configuration registers as well as to perform other lOPs. The 
MCH also includes a device register data (DRD) register 10 
314. The DRD register 314 is at address offset 90-91h in 
PCI configuration space, the default value is OOOOh (16 bits), 
and the register is a read/write register. The fields of the 
DRD register are shown in Table 1. 

TABLE 1 



An Embodiment of the DRD Register 

Bit Description 

15:0 Register Data (RD): Bits 15:0 contain the 16 bit data to be written to a RDRAM 

register or the data read from a RDRAM register as a result of IOP execution. Data will 
be valid when the HO bit of RICM register transitions from 1 to 0 

25 

The MCH 300 also includes a RDRAM Initialization 
Control Management (RICM) Register 312. The RICM 



TABLE 2 

An Embodiment of the RICM Register 

Bit Description 

23 Initiate Initialization Operation (IIO): When set to 1, the execution of the 

initialization operation specified by the IOP field (below) starts. After the execution is 
completed, the MCH clears the IIO bit to 0. A software program should check to see if 
this bit is 0 before writing to it. Data from operations which specify a register data 
read from the RDRAM will be valid in the DRD register when the IIO bit is cleared to 
0. 

22:21 RESERVED: These bits are not used for normal initialization operations. 
20 Initialization Complete (IC): BIOS sets this bit to 1 after initialization of the 

RDRAM memory array is complete. 
19 Broadcast Address (BA): When BA is set to 1, the initialization operation (IOP) is 
broadcast to all devices in the channel. When BA is set to 1, the SDA field (below) is 
not used. 

17:9 Device Register Address (DRA): This field specifies the register address for the 

register read and write operations. 
8:4 Serial Device/Channel Address (SDA): This 5 bits field specifies the following: 

the serial device ID of the RDRAM device for RDRAM Register Read, RDRAM 
Register Write, RDRAM Set Reset, RDRAM Clear Reset and RDRAM Set Fast 
Clock Mode IOP commands. 

the device ID for Powerdown Entry, Powerdown Exit, Nap Entry, Nap Exit, 
Current Calibrate and Current Calibrate & Sample IOP commands, 
the bank address for Refresh and P recharge IOP commands 

18, Initialization Opcode (IOP): This field specifies the initialization operation to be 

3:0 done on a RDRAM device or the MCH RAC. 
Bit5|18, 3:0] Operation Specified 

0 0 0 0 0 RDRAM Register Read 

0 0 0 0 1 RDRAM Register Write 

0 0 0 1 0 RDRAM Set Reset 

0 0 0 1 1 RDRAM Clear Reset 

0 0 1 0 0 RDRAM Set Fast Clock Mode 

0 0 10 1 Reserved 

0 0 110 RDRAM Temperature Calibrate Enable and then Temperature 
Calibrate 

0 0 1 1 1 to 0 1 1 1 1 Reserved 

1 0 0 0 0 RDRAM Core Initialization (RCI) 
1 0 0 0 1 RDRAM SIO Reset 

10 0 10 RDRAM Powerdown Exit 

10 0 11 RDRAM Powerdown Entry 

10 10 0 RDRAM "Current Cal" and "Current Cal + Sample" 
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TABLE 2-continued 



An Embodiment of the RICM Register 



Bit Description 



10 10 1 Manual Current Calibration of MCH RAC 

10 110 Load MCH RAC control register with data from DRD register 

10 111 Initialize MCH RAC 

1 1 0 0 0 RDRAM Nap Entry 

110 0 1 RDRAM Nap Exit 

110 10 RDRAM Refresh 

110 11 RDRAM Precharge 

All other combinations are reserved. 

More details on the operations specified by IOP field is shown in Table 3 below. 



15 



20 



25 



30 



35 



45 



50 



55 



60 

Also illustrated in FIG. 3 is an initialization control circuit 
320 which includes an RDRAM IOP execution circuit 325. 
Details of the various IOPs executed by the control circuit 
320 are illustrated in Table 3. In Table 3, the broadcast 55 
address (BA) field (bit 19) and the SDA field (bits 8:4) are 
listed either as one of the following: 
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TABLE 3 



IOP Operation Details 



Bits (18, 3:0] Operation Name BA SDA Details 



0 0 0 0 0 RDRAM 

Register Read 



0 0 0 0 1 RDRAM 

Register Write 



0 0 0 1 0 RDRAM Set 
Reset 



0 0 0 1 1 RDRAM Clear 
Reset 



0 0 1 0 0 RDRAM Set 

Fast dock Mode 



0 0 110 RDRAM 

Temperature 
Calibrate Enable 
and then 
Temperature 
Calibrate 

1 0 0 0 0 RDRAM Core 

Initialization 
(see FIG. 4) 



1 0 0 0 1 RDRAM SIO 
Reset 



0 x This IOP performs the serial read of 

the RDRAM register specified by 
SDA and DRA fields. The data read 
will be available in DRD register 
when the no bit is cleared to 0. 
x x This IOP performs the serial write 
of the RDRAM register specified 
by SDA and DRA fields. The write 
data is provided in the DRD 
register. A write operation to all 
RDRAM devices on the channel 
can be performed by setting the BA 
field to 1. 

x x This IOP performs the serial setting 
of a reset bit in an RDRAM device 
specified by the SDA field. 
The setting of the reset bit begins a 
period for the RDRAM device to 
reset and prepare to respond to all 
other defined operations. The Set 
Reset IOP also puts the RDRAM in 
active mode. 

x x This IOP performs the serial 
clearing of the reset bit in an 
RDRAM device specified by SDA 
field. 

The Clear Reset operation puts the 
device into Powerdown state. A 
minimum of 4 SCK cycles must 
pass after the SIO Request Packet 
before the RDRAM device is 
allowed to exit this Powerdown 
state. 

The Clear Reset operation may not 
be issued before greater than 16 
SCK cycles have occurred after the 
Set Reset operation, 
x x The Set Fast Clock Mode operation 
prepares the RDRAM device to 
transmit and receive data on RSL 
signals using RDRAM clock 
(RCLK). 

1 x Upon receiving this IOP, the MCH 

issues a 'Temperature Calibrate 
Enable" SIO request packet 
followed immediately by a 
"Temperature Calibrate" SIO 
Request packet to all RDRAMs. 
NE NE Upon receiving this IOP command 
the MCH does the following: 

1. Broadcast Powerdown Exit. 

2. Initialize all RDRAM cores of 
all RDRAM devices on the 
channel. 

3. Broadcast Temp Cal Enable 
and Temp Cal. 

4. Broadcast NAP entry (if bit 6 
(PBS) of DRAMC register is 
1). 

5. If IC bit (bit 20) of RICM 
register is set to 1 along with 
this command, then the MCH 
enables RDRAM Refresh, 
RDRAM Current Cal, 
RDRAM Temp Cal, and 
RDRAM DLL Refresh logic 
after this command 
completes. 

NE NE This IOP sends an SIO pin 
initialization sequence to all 
RDRAMs. When this operation 
occurs the SIO0 pin on the 
RDRAM is configured as input and 
SIOl pin is configured as output. 
Additionally, the SIO repeater bit 
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TABLE 3-continued 



IQP Operation Details 



Bits [18, 3:0] Operation Name BA SDA Details 



10 0 10 RDRAM 

Powerdown Exit 



3 0 0 1 1 RDRAM 

Powerdown 
Entry 



10 10 0 RDRAM 

"Current Cal" 
and "Current 
Cal + Sample'* 



10 10 1 Manual Current 
Calibration of 
MCHRAC 

10 110 Load MCH RAC 
control register 
with data from 
DRD register 

10 111 Initialize MCH 
RAC 



1 1 0 0 0 RDRAM Nap 
Entry 



110 0 1 RDRAM Nap 
Exit 



110 10 RDRAM 
Refresh 



110 11 RDRAM 
Precharge 



is set to 1. 

x x Upon receiving this IOP, the MCH 
initiates a Powerdown exit 
sequence for the RDRAM device 
specified by SDA and BA fields. 
The SDA field should contain the 
device ID, not the serial device ID. 

x x Upon receiving this IOP, the MCH 
sends a Powerdown Entry PCP 
packet to the RDRAM device 
specified by SDA and BA fields. 
The SDA field should contain the 
device CD, not the serial device ID. 

x x Upon receiving this IOP, the MCH 
sends three Current Calibrate SCP 
packets followed by one Current 
Calibrate and Sample SCP packet 
to the RDRAM device specified by 
SDA field. 

NE NE Upon receiving this IOP, the MCH 
initiates a manual Current 
calibration operation cf MCH 
RAC. 

NE NE Upon receiving this IOP, the MCH 
loads the MCH RAC control 
register with the data from the DRD 
register. 

NE NE Upon receiving this IOP, the MCH 
initializes the MCH RAC. The 
MCH RAC initialization includes 
Power Up sequence, Current 
Calibration and Temperature 
Calibration of the MCH RAC. 
After executing this command, the 
MCH enables the periodic Current 
and Temperature Calibration of the 
MCH RAC even if the IC bit is not 
set to 1 . 

x x Upon receiving this IOP, the MCH 
sends a Nap Entry PCP packet to 
the RDRAM device specified by 
SDA and BA fields. The SDA field 
should contain the device ID, not 
the serial device ID. 

x x Upon receiving this IOP, the MCH 
initiates a Nap exit sequence for the 
RDRAM device specified by SDA 
and BA fields. The SDA field 
should contain the device ID, not 
the serial device ID. 

1 x Upon receiving this IOP, the MCH 
sends a Refresh PCP packet to the 
specified bank of all RDRAM 
devices. The bank address is 
specified by SDA field. 

1 x Upon receiving this IOP, the MCH 
sends a Precharge PCP packet to 
the specified bank of all RDRAM 
devices. The bank address is 
specified by SDA field. 



NE: This field has no effect on the initialization operation 
0: This field is to be set to 0 for this initialization operation. 
1: This field is to be set to 1 for this initialization operation. 

x: This field should be programmed as appropiate for the particular initialization opera- 
tion. 



60 

Details of operations conducted by one embodiment of 
the initialization control circuit 320 in response to receiving 
the RDRAM Core Initialization IOP (10000b) are shown in 
FIG. 4. In block 400, a broadcast powerdown exit command 
is issued on the bus. Next, as per block 405, the sequence 65 
indicated by blocks 410 to 470 is repeated sixteen times for 
bank addresses zero to thirty-one. These numbers may be 



appropriate for a memory subsystem having one hundred 
and twenty-eight current calibration levels and up to thirty- 
two banks. In other embodiments, a different number of 
repetitions may be used if, for example, a larger or smaller 
number of current calibration levels are available. Similarly, 
differing numbers of banks may be available in different 
systems. 
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In block 410, no operation is performed to ensure that the 
powerdown exit is complete and that the refresh operation 
(REFA command) is properly performed in block 415. Id 
block 420, another no operation command is executed, 
followed by two more refresh operations (REFA) in blocks 5 
425 and 430. Three more no operation commands are 
executed in block 435, allowing sufficient time to pass 
before a refresh precharge (REFP) command occurs. After 
another no operation command in block 445, another refresh 
precharge (REFP) command is executed in block 450. 10 

A calibrate (CAL) command is next executed in block 
455. This command calibrates (drives) \ OL current for the 
presently indicated device. As indicated in blocks 460 and 
465, this operation may be repeated twice. Then, as indi- 
cated in block 470, a sample (SAMR) command is executed. 15 
The sample command updates the \ OL current for the pres- 
ently indicated device. Until all sixteen repetitions for the 
thirty-two banks are performed, this process is repeated. 

Initialization Sequence 20 

With the above initialization operations, a system may be 
initialized. For example, the system shown in FIG. 5, which 
implements a Rambus Direct RDRAM channel, may be 
initialized. In this system, a memory controller 500 (also 
referred to as a memory control hub or MCH) orchestrates 25 
initialization activities. The memory controller also initiates 
specific ROW/COLUMN packets on the channel. A serial 
interface 540 may be used to communicate with devices on 
the channel. For example, clock (SCK), serial frame (CMD), 
and bi-directional serial I/O (SIO0 and SIOl) pins may be 30 
used to read and write RDRAM configuration registers as 
well as to perform other IOPs. 

The memory controller includes a Rambus ASIC Cell 
(RAC) 530, a control circuit 520, and a variety of registers. 35 
The registers include a initialization registers 515, which are 
used to initialize the system memory, and powerdown res- 
toration registers 510. The powerdown restoration registers 
contain timing and other information crucial to operating the 
memory channel. In other words, the powerdown restoration 
registers are simply registers that need to be restored after 
powering down the memory controller 500 in order to 
resume accesses to the memory channel. The registers may 
be PCI configuration registers. 

The memory channel includes RIMM modules 560, 565, 45 
and 570 that are connected to the MCH 500 by a control and 
data bus 532 and a serial bus 542. The control and data bus 
532 may be terminated by a resistive termination 533, and 
a Direct Rambus Clock Generator (DRCG) 580 may be 
provided at the far end of the channel from the MCH 500 to 50 
provide clock signals over signal lines 582. 

Additionally, the system includes an Input/Output control 
hub (ICH) 505 which couples the MCH to a secondary bus 
506 and may contain a second serial interface circuit 544 for 
interfacing with a second serial bus 546. A serial presence 55 
detect (SPD) memory 572 (a non -volatile memory such as 
an electrically erasable and programmable read only 
memory) for each module may be read via the serial 



interface 544 according to a serial presence detect protocol. 
The SPD memory 572 may provide information such as 
timing information., device organization, and device tech- 
nology about each particular memory module. More details 
of the SPD protocol are discussed in the "Serial Presence 
Detect Application Brief" as well as the Direct Rambus'™ 
RIMM™ Module and the 64/72 Mbit Direct RDRAM™ 
data sheets available from Rambus. 

In one embodiment, the serial bus 546 is an 12 C bus such 
as a system management bus (SMBus). This embodiment 
includes clock (SMBCLK) and data (SMBDATA) signals 
that follow the industry defined System Management Bus 
(SMBus) protocol as defined in tie System Management 
Bus Specification, Revision 1.0, available from the Smart 
Battery Implemented Forum. 

The ICH has general purpose outputs (GPOs) which are 
used to control various system functions such as setting the 
frequency of the DRCG 580. A non-volatile memory 585 
containing the BIOS may be coupled to the secondary bus 
506, as well as a battery backed-up random access memory 
590. The battery backed-up memory 590 may store power- 
down restoration configuration values 592 for the MCH 
powerdown registers 510 so the MCH can resume accessing 
the RDRAM channel without performing the full initializa- 
tion sequence detailed below. 

Briefly, the initialization process may be summarized as 
follows. After power up reset, the configuration information 
from Serial Presence Detection (SPD) data on the RIMMs in 
a channel is read. For example, a storage device, SPD 
memory 572, stores configuration information for the 
RDRAMs 573, 574, 576, and 577 on the RIMM 570. The 
memory controller configuration registers are programmed 
with the appropriate values from the SPD information, and 
then the RDRAM device IDs are programmed such that each 
RDRAM device can be uniquely identified and accessed by 
the memory controller. Once a device has been initialized, it 
can be used. 

Each RDRAM device has two identification numbers that 
are used to uniquely select a device on the channel, the Serial 
Device ID, and the Group Device ID. These two IDs are 
used for distinct operations on the RDRAM channel. The 
serial device ID is used to select devices when the memory 
controller is sending initialization operations on the SCK, 
SIO, and CMD signals of the RDRAM channel. The group 
device ID is used by the memory controller to select a device 
when sending ROW packets and COLUMN packets on 
RQ[7:0] signals of the RDRAM channel. Both the serial 
device ID and the group device ID are programmed after 
reset and before devices may be individually addressed by 
initialization operations (IOPs) and ROW/COLUMN 
packets, respectively. 

Looking at the initialization process of the Rambus chan- 
nel in more detail, a particular sequence may be followed to 
achieve correct operation of the RDRAM devices on the 
channel. FIG. 6 illustrates a flow diagram for proper channel 
initialization in one embodiment, and Table 4 enumerates 
some of the variables used in this initialization flow. 



TABLE 4 



Variables Used in Initialization 



Width 

Name (bits) Description 

RIMMMax 2 Maximum number of RIMMs present. 



09/03/2003, EAST Version: 1.04.0000 



US 6,378,056 B2 



15 



16 



TABLE 4-continucd 



Variables Used in Initialization 



Name 



Width 

(bits) Description 



0 No RIMMs present 
1-3 1-3 RIMM(s) present 

2 Counter used during initialization to select a RIMM. 
5 Number of RDRAM devices in a particular RIMM. 
5 Maximum number of devices present on a channel 

0-31 1-32 RDRAM devices present on the channel 
5 Counter used during group device ID enumeration to 
indicate # of devices that have been assigned group 
IDs. 

5 Serial Device ID index used to select devices on a 
channel. 

0-31 Maps to serial device ID 0-31 
5 Group Device ID index used during group device ID 
enumeration to assign a Group Device ID to the next 
RDRAM device. 

0-31 Maps to group device ID 0-31 
8 Byte indicating RDRAM technology definition. Bit 
definition matches GAR register. 

3 Index into table of DRAM technologies supported by 
MCH. Used during group device ID enumeration 
assign group IDs to RDRAMs in a technology 
descending order. 

3 Temporary storage of maximum Mch Trdly during 
channel levelization procedure. Bit definition matches 
the MCH's tRDLY field in the MCH RDT register. 
32 32-bit CPU address used to test a RDRAM device 
during channel levelization. 

8 Temporary index used during algorithm. 



REMMCount 
RIMM Devi ceCount 
MemberMax 

MemberCount 



SeriallDCount 
GroupDevicelDCount 

RIMMDeviceConfigNo 
DRAMConfiglndex 

MchTrdly 

DeviceTes tAddress 
Templndex 



In block 602, system reset occurs. The MCH resets all its 
state machines and prepares for initialization. In block 604, 
memory module configuration of the system is verified. The 35 
BIOS reads SPD data to determine the memory configura- 
tion. If only RIMMs are present, the RDRAM initialization 
sequence may proceed with block 608. If mixed memory 
modules are present, an error is posted to the user and the 
system is halted as indicated in 606. ^ 

The clock generator is started in block 608. This operation 
may be accomplished by software querying the SPD data of 
every RIMM module present on the motherboard and deter- 
mining a channel frequency at which all RIMMs may 
operate. The DRCG 580 may be set to the proper frequency 45 
by a general purpose output (i.e., GPOx as shown in FIG. 5) 
from the ICH 505. In one embodiment, the BIOS waits at 
least 8 ms between this step and the MCH RAC initializa- 
tion. 

As indicated in block 610, the MCH RAC is next initial- 50 
ized. The channel clock from the DRCG should be stable 
prior to MCH RAC initialization. The MCH RAC initial- 
ization is accomplished by executing the MCH RAC ini- 
tialization IOP. The RAC initialization IOP performs basic 
initialization to prepare the internal RAC of the memory 55 
controller for normal operation. 

In one embodimenl, the BIOS provides a time out of 5 ms 
for the IIO bit to clear after the MCH RAC initialization IOP. 
If the IIO bit is not cleared by the MCH after 5 ms, the BIOS 
should report the error, and the channel is unusable. An 60 
additional 5 ms delay may be added after the MCH clears the 
IIO bit due to completion of the MCH RAC initialization 
IOP. This allows sufficient time for the MCH clocks to 
stabilize and lock. Also in some embodiments, a bus in the 
RAC may need to be cleared before other operations com- 65 
mence. This may be accomplished by executing the MCH 
RAC Control Register Load IOP (DRD-OOOOOh). It may 



also be possible to perform the RAC initialization at a later 
point in the initialization sequence in some embodiments. 

As indicated in block 612, a number of MCH configura- 
tion registers may next be initialized. In one embodiment, 
the paging policy register RMC idle timer (PGPOL RIT) 
field (MCH 052h [2:0]) is set to 001b to ensure no pages are 
closed during channel levelization (discussed below). The 
PGPOL RIT field sets the number of host bus clocks that the 
memory controller will remain in the idle state before all 
open pages are closed, and a value of zero indicates that 
there will be an infinite latency before the memory controller 
starts closing pages. 

Additionally, in some embodiments, operating pools may 
be used to group RDRAMs based on defined RDRAM 
states. In order to reduce operating power, the RDRAM 
devices may be grouped into two operating pools called 
"Pool A" and "Pool B." In one embodiment, up to eight 
devices may be in Pool A at a time. In this embodiment, up 
to four out of eight devices in Pool A may be in Active 
Read/Write or Active states at a time, and the devices in Pool 
A are in either Active ReadAVrite, Active, or Standby states. 

The maximum number of devices in Pool A is program- 
mable and is specified by a PAC field of the RDRAM power 
management register (RPMR) register (MCH 053b). All 
devices that are not in Pool A arc members of Pool B. All 
devices in Pool B are either in the Standby or Nap state. The 
state of the devices in Pool B is specified by a PBS field of 
a DRAM control (DRAMC) register (MCH 051h). In one 
embodiment, the RPMR register is set to OOh, selecting a 
pool A of 1 device only, and Pool B operation is set for 
standby operation (MCH 051h [6]=0). 

Next, as indicated in block 614, additional channel ini- 
tialization may be performed. This may include performing 
an SIO (serial interface) reset using the SIO reset IOP, and 
allowing sufficient delay for completion of the SIO reset 



45 



09/03/2003, EAST Version: 1.04.0000 



US 6,378,056 B2 



17 



18 



25 



30 



sequence. Additionally, other registers which may need to be 
initialized for proper operation may be set at this point. For 
example, in some embodiments, a Test77 register may need 
to be written to with a zero value after the SIO reset as 
specified on page 37 of the Direct RDRAM 64/72 Mbit Data 5 
Sheet (execute a Broadcast SIO Register Write IOP: 
TEST77, DRA=4 Dh, DRD=0000h). 

Serial Device ED Assignment 

As indicated in block 620, serial device identification 10 
values (IDs) may be assigned next. In general, the software 
uniquely identifies each device on the channel to allow 
initialization operations to be targeted at individual devices. 
The serial device ID for each RDRAM is stored in the 
RDRAM INIT register (index 21h) in bits 4-0. After SIO 15 
reset, the default value of the serial device ID is 1 Fh in all 
RDRAMs on the channel. Also, after reset, the Serial 
Repeater (SRP bit (RDRAM 021h [7]) is set to 1, enabling 
each RDRAM to propagate SIO data received on SI 00 to the 
RD RAM's SIOl pin, passing the SIO packet to the next 20 
RDRAM device. Since all devices have the same serial 
device ID after reset, an individual device may not be 
accessed prior to assigning unique serial IDs. 

Further details of the serial device enumeration performed 
by one embodiment are shown in FIG. 7. In block 700, the 
variable SeriallDCount is initialized to zero. Next, as indi- 
cated in block 705, the SIO repeaters of all devices on the 
channel are disabled (Broadcast SIO Register Write IOP. 
INIT, DRA=21h, DRD«001Fh). This operation causes all 
serial device IDs to be set to 01 fh. The SIO repeater bit is set 
to zero, so only t he first device on the SIO channel can be 
accessed. 

Starting with block 710, the process loops through all 
devices on the channel and assigns a unique ID to each. The 35 
serial ID of the current device is set to SeriallDCount and the 
SIO repeater bit is enabled (SIO Register Write IOP: INIT, 
SDCA=lFh, DRA=21h, DRD=0080h+SerialIDCount). 
Next, whether the device is actually present and functioning 
in the system is tested as indicated in block 715. The 4Q 
RDRAM INIT register is read to determine if the same value 
which was just written is properly read back out (SIO 
Register Read IOP. INIT, SDCA-SeriallD Count, DRA- 
21h). 

If the data matches (as tested in block 720), seriallDcount 45 
is incremented (block 725), and the SeriallDCount is 
checked to see whether a maximum number of devices (e.g., 
thirty-two) have been given IDs (block 730). If the SeriallD- 
Count still indicates a valid serial ID, the next device is 
identified in block 705. 50 

If the SeriallDCount exceeds the maximum permissible 
value, or if the data did not match in block 720, then the last 
device has been given an ID, and a variable tracking the total 
number of devices may be set to the seriallD Count as 
indicated in block 735. Finally, to disable any additional 55 
devices beyond the last permitted device, the SIO repeater of 
the RDRAM with the highest serial ID is disabled as shown 
by block 740. Accordingly, any additional devices (i.e., 
improperly functioning devices or devices beyond the 
maximum, e.g., thirty -two) do not receive commands and 60 
therefore should not respond. As an additional check, the 
SPD information on the RIMMs may be examined to 
determine if the final device count is correct. 



Group Device ID Assignment 

Returning to FIG. 6, after the unique serial IDs have been 
assigned and the SIO output of the last device disabled, 



65 



group IDs are assigned based on memory device size as 
indicated in block 630. In one embodiment, the MCH 
supports up to thirty-two RDRAM devices and eight groups. 
Each group has up to four devices and has a group boundary 
access register (GBA) to define the group ID and the upper 
and lower addresses for each group. Thus, each GBA 
register may be programmed with a group ID and a nine bit 
upper address limit value. Unpopulated groups may have a 
value equal to the previous group and a group size of zero. 

Additionally, the flowchart in FIGS. 8A-8C illustrates 
one embodiment of the process of enumerating group device 
IDs indicated in block 630. As indicated in block 800 in FIG. 
8A, a number of variables are initialized. Variables 
SeriallDCount, GroupDevicelDCount, RIMMCount, 
RIMMDevice Count, and RIMMDeviceConfigNo are initial- 
ized to zero. ADRAMConfiglndex variable is initialized to 
a value indicating the largest core technology supported by 
the MCH. 

As indicated in block 805, data is read from the SPD 
memory of a module (module number RIMMCount) iden- 
tifying the core technology of that module. This information 
may include the number of rows per device, the number of 
columns per device, the number of banks per device, and 
whether the banks are dependent or independent. Next, as 
indicated in block 810, the RIMMDeviceConfigNo is set by 
translating the core technology value read from the SPD into 
a value in a Group Architecture (GAR) register equivalent 
value. 

Next, as indicated in block 815, the RIMMDevice Count 
variable is set to the number of devices indicated by the SPD 
memory for that RIMM. Thereafter, the device IDs may be 
assigned and associated register values set as indicated in 
block 820. Further details of the process indicated in block 
820 for one embodiment are shown in FIG. 8B. 

In general, the enumeration process adds the number of 
RDRAM devices on a RIMM to the first Serial ID and then 
counts down until the RIMM is finished. Therefore, as 
indicated in block 822, whether RIMMDeviceConfigNo 
equals the DRAMConfiglndex is tested to determine 
whether group device IDs have been assigned for all devices 
in a particular core technology. If they are unequal, all 
devices for that core technology have group IDs, so the 
SeriallDCount is set to SeriallDCount plus RIMMDevice- 
Count (as indicated in block 830) and the process returns to 
FIG. 8 A as indicated in block 832. Additionally, if RIM- 
MDeviceCount is zero (as tested in block 824) or Member- 
Count is zero (as tested in block 826), there are no more 
devices to give group IDs and the process returns to FIG. 8 A 
as indicated in block 832. 

If RIMMDeviceCount and MemberCount are not zero, a 
GroupDevicelDCount is assigned to be the group device ID 
of the RDRAM with the serial ID equal to the present value 
of SeriallDCount as indicated in block 828. Next, the current 
group boundary address register (GBA) is updated to reflect 
the addition of the new device to this group as indicated in 
block 830. This may be accomplished by adding a value 
indicative of the device size to the previous value stored in 
that GBA register. 

Next, the GroupDevicelDCount is compared to four (the 
maximum number of devices per group in one embodiment) 
in block 832. If the group is full, the MCH Group Archi- 
tecture Register (GAR) for that group is updated as indicated 
in block 834. The GAR is updated to properly indicate the 
group configuration (i.e., the number of banks and the 
DRAM technology (size)). In block 836, SerialDevice- 
IDCount is incremented, MemberCount is decremented, 



09/03/2003, EAST Version: 1.04.0000 



US 6,378,056 B2 



19 



20 



10 



15 



20 



GroupDevicelDCount is incremented, and RIMMDevice- 
Count is decremented. The process then returns to block 
824. 

Returning to FIG. 8 A, if either RIMMDe vice Count or 
MemberCount is zero, RIMMCount is incremented as indi- 
cated in block 850. If RIMMCount is less than a maximum 
RIMMCount, as tested in block 855, then the process returns 
to block 805. If the RIMMCount has reached the last RIMM, 
the process continues in FIG. 8C as indicated by block 860. 

Turning to FIG. 8C, if MemberCount is zero (as tested in 
block 865), the device ID enumeration process ends. If, 
however, MemberCount is not zero, the next MCH group is 
selected to start enumerating the devices in the next DRAM 
technology as indicated in block 870. GroupDevicelDCount 
may be updated by adding three and performing a logical 
AND operation of the resulting value and OFFFCh. 

If GroupDevicelDCount is a maximum number devices 
allowed in the channel (e.g., thirty-two as tested in block 
872), then the group ID enumeration process ends. If, 
however, fewer devices have been given group ID numbers, 
the DRAMConfiglndex is set to the next smallest core 
technology supported by the MCH as indicated in block 874. 
If the DRAMConfiglndex indicates that there are no smaller 
core technologies supported (e.g., DRAMConfiglndex is 
zero as tested in block 876), then the ID enumeration process 25 
ends. If there are more core technologies, seriallD Count and 
RIMMCount are reset to zero, as indicated in block 878, and 
the process returns to block 805 in FIG. 8A. 

The psuedo-code below indicates operations that may be 
used to perform the group ID enumeration indicated by 
block 630 of FIG. 6 in one embodiment, 
630. Enumerate MCH device groups. 

630.1. Loop through RIMM SPD memory and group the 
devices on the RIMMs. The largest technology devices 
must be grouped in the lowest groups, with the tech- 
nology size decreasing as the group #s increase. 

630.1.1. Set MemberCount-MemberMax 

630.1.2. Set SerialIDCount=0. This is the Serial Device 
ID counter 

630.1.3. Set GroupDevicelDCountoO. This is the 
Group Device ID counter 

630.1.4. Set RIMMCount=0. This is the RIMM counter 

630.1.5. Set RIMMDeviceCount=0. This is the counter 
for the # of devices on a RIMM. 

630.1.6. DRAMConfigIndex»Largest technology sup- 
ported by MCH 

630.1.7. Compute RIMM #RIMMCount's core tech- 
nology 

630.1.7.1. RIMMDeviceConfigNo=core technology 
read from RIMMs SPD. 

630.1.8. RIMMDeviceCount=# of RDRAM devices in 
RIMM #RIMMCount, read from the RIMM's SPD 
EEPROM. 

630.1.9. Assign group device IDs and program MCH 
GAR and GBA registers for RIMM. 
630.1.630.1. If RIMMDeviceConfigNo!- 

DRAMConfiglndex, break to 630.1.9.1 

630.1.9.2. If RIMMDeviceCount-0, break to 
630.1.10 

630.1.9.3. If MemberCount=0, break to 630.1.10 

630.1.9.4. SIO Register Write IOP. DEVID, SDCA= 
SeriallDCount, DR A«40h, D RD = 
GroupDevicelDCount. 

630.1.9.5. Program MCH GBA 
[GroupDevicelDCount SHR 2]-MCH GBA 
[GroupDevicelDCount SHR 2-l]+RlMM #RIM- 
MCount device size. 
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630.1.9.6. If GroupDevicelDCount AND 011b=0 
630.1.9.6.1. Program MCH GAR 

[GroupDevicelDCount SHR 
2]=RIMMDeviceConfigNo 

630.1.9.7. Increment GroupDevicelDCount 

630.1.9.8. Increment SeriallDCount 

630.1.9.9. Decrement MemberCount 

630.1.9.10. Decrement RIMMDeviceCount 

630.1.9.11. Go to step 630.1.9 2 

630.1.10. Increment RIMMCount 

630.1.11. If RlMMCount<RIMMMax, go to step 
630.1.7 

630.1.12. If MemberCount-0 then break to step 10 

630.1.13. Select next group for next RDRAM technol- 
ogy* 

630.1.13.1. GroupDevicelDCount- 
(GroupDevicelDCount+Ollb) AND 011b 

630.1.14. If GroupDeviceIDCount=32 then break to 
step 10 

630.1.15. DRAMConfigIndex=next smallest DRAM 
technology 

630.1.16. If DRAMConfigIndex=0, then break to step 
10 

630.1.17. SerialIDCount=0 

630.1.18. RIMMCounNO 

630.1.19. Go to step 630.1.7. This will begin searching 
the RIMMs for the next smallest RDRAM technol- 
ogy- 
Returning to FIG. 6, after the group IDs have been 

assigned, the individual RDRAM devices may be brought 
out of powerdown mode and put into fast clock mode for 
normal operation as indicated in step 640. The individual 
RDRAM timing registers in the MCH and RDRAMs may be 
programmed. The REFB and REFR RDRAM control reg- 
isters may also be initialized (Broadcast SIO Register Write 
IOP. REFB, DRA=41h, DRD=0000h; Broadcast SIO Reg- 
ister Write IOP. REFR, DRA-42h, DRD-OOOOh). 

The RDRAM devices may be reset by executing a Broad- 
cast Set Reset IOP, followed by an appropriate delay (e.g., 
32 us), then executing a Clear Reset IOP, also followed by 
an appropriate delay (e.g., 4 us) to allow for the reset 
operation to complete. The RDRAMs are brought out of 
powerdown by executing a broadcast RDRAM power down 
exit IOP, and the fast clock mode is entered by executing a 
broadcast RDRAM Set Fast Clock Mode Initialization IOP. 

Thereafter, the RDRAM cores may be initialized as 
indicated in block 642. Further details of one embodiment of 
the RDRAM core initialization are shown in FIG. 9. As 
indicated in block 900, the RDRAM devices are prepared for 
current calibration by writing an intermediate value to the 
appropriate RDRAM registers (Broadcast SIO Register 
Write IOP. CCA, DRA-43h, DRD-0040h; Broadcast SIO 
Register Write IOP. CCB, DRA=44h, DRD=0040h). Forty 
hexadecimal may be an appropriate intermediate value in an 
embodiment that has one hundred and twenty-seven possible 
current calibration levels. Starting at this intermediate value 
limits the total number of calibration cycles needed since the 
calibration value could only be off by approximately half 
than the full range of calibration values. 

Next, precharge operations are performed on each bank of 
each RDRAM device. To perform the precharge operations, 
the MCH counts up through the banks by two, first pre- 
charging odd banks, and then even ones. A bank index is set 
to zero in block 905. A broadcast precharge IOP is then 
executed as indicated in block 910. The bank index value is 
incremented by two as indicated in block 915, and the 
broadcast precharge is repeated for even banks until the bank 
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index is found to be equal to a maximum number of banks 
(e.g., thirty two) in block 920. 

Once the maximum number of banks is reached, the bank 
index is set to one (as indicated in block 930), and all odd 
banks are precharged. Once the bank index exceeds the s 
maximum number of banks, the RDRAM Core Initialization 
IOP is executed six times as indicated in block 940. 

Channel Levelization 

Returning to FIG. 6, after the initialization of the 10 
RDRAM cores in block 642, the channel may be levelized 
as indicated in block 644. This process involves equalizing 
the sum of the RDRAM read response time and a propaga- 
tion delay from the RDRAM to the MCH for all RDRAMs. 
In other words, once the channel is levelized, all RDRAMs 35 
will provide data at the memory controller in the same 
number of bus cycles. 

The following psuedo-code indicates a sequence of steps 
that may be performed in one embodiment to implement the 2Q 
levelization process indicated in block 644. 
644. Levelize the Rambus channel 

644.1. Phase 1: Determine MCH tRDLY field value. 

644.1.1. SeriaiIDCount«MemberMax 

644.1.2. MchTrdly-0 25 

644.1.3. Program MCH RDT: TRDLY field=MchTrdly. 

644.1.4. Compute the 32 bit address to test the 
RDRAM device for levelization. 

644.1.4.1. SIO Register Read IOP. DEVID, SDCA= 
SeriallDCount, DRA=40h 30 

644.1.4.2. The DRD (MCH 090h [15:0]) now con- 
tains the RDRAM's Device ID 

644.1.4.3. DeviceTestAddress«MCH GBA[(DRD 
SHR 2)-l] SHL 23+((DRD AND 011b) * device 
size in bytes (from GAR[DRD SHR 2J) 35 

644.1.5. Do QWORD write operation to address 
DeviceTestAddress with TestPattern. 

644.1.6. Do QWORD read operation to address 
DeviceTestAddress 

644.1.7. If data read! -TestPattern 40 

644.1.7.1. Increment MCH RDT:TRDLY field. 

644.1.7.2. If MCH RDT:TRDLY field<=4 then break 
to step 644.1.5. 

644.1.8. Else (if data read=TestPattern) 

644.1.8.1. MchTrdly data read from MCH RDT- 45 
:TRDLY field 

644.1.8.2. if MchTrdly=4 then break to step 644.2 

644.1.9. Decrement SeriallDCount 

644.1.10. If SerialIDCount>-0 then go to step 6441.3 

644.2. Phase 2: Determine the RDRAM 's levelization 50 
timing values 

644.2.1. SeriallDCount-MemberMax 

644.2.2. Compute the 32 bit address to test the 
RDRAM device for levelization. 

644.2.2.1. SIO Register Read IOP. DEVID, SDCA=> 55 
SeriallDCount, DRA-40h 

644.2.2.2. The DRD (MCH 090h [15:0]) now con- 
tains the RDRAM's Device ID 

644.2.2.3. DeviceTestAddress-MCH GBA[(DRD 
SHR 2)-l] SHL 23+((DRD AND 011b) * device 60 
size in bytes (from GAR[DRD SHR 2]) 

644.2.3. Do QWORD write operation to address 
DeviceTestAddress with TestPattern. 

644.2.4. Do QWORD read operation to address 
DeviceTestAddress 65 

644.2.5. If data read=TestPattern then break to step 
644.2.8 



644.2.6. If TCDLY field of RDRAMs<Max TCDLY 
(from SPD) 

644.2.6.1. Increment the RDRAMs TCDLY registers 
(TDAC & TRDLY) according to the TCDLY 
support table. 

644.2.6.2. Break to step 644.2.3 

644.2.7. Mark the RDRAM device to be disabled. 

6442.8. Decrement SeriallDCount 

644 2.9. If SerialIDCount>=0 then go to step 64422 
After levelization completes, one embodiment stores a 

number of powerdown recovery memory initialization val- 
ues in the battery backed-up memory 590 of FIG. 5 as 
indicated in block 646. Notably, this operation may be 
performed at any other stage after the appropriate values 
have been determined by the initialization routine. The 
values are saved to preserve the initialization information 
determined by the initialization process to this point. 

When a low power state (e.g., suspend-to -RAM) is 
entered by the system, power to the MCH may be removed. 
Thus, if the initialization information is not preserved, the 
entire initialization process may have to be repeated. Storing 
key initialization information to a non-volatile memory may 
advantageously speed wake-up from such a low power state. 
The difficulty of storing such information is increased by the 
fact that the memory subsystem will not be functional until 
these values are restored. 

Any non- volatile memory which can be written to may be 
used to store the appropriate initialization information; 
however, a battery backed-up memory is present in many 
computer systems and therefore may be a convenient choice. 
In one embodiment, the registers below are stored in the 
memory 590. 

MCH Group Architecture (GAR) registers (O40-047h): 
These registers indicate device configuration for each 
group such as the number of banks and the DRAM 
technology (size). 

MCH RDRAM Timing Register RDT (050h): This reg- 
ister defines the timing parameters for all devices in the 
channel. 

MCH DRAM Control (DRAMQ register (051h): This 
register includes the Pool B Operation Select (PBS) bit, 
a memory transfer hub presence bit (MTHP), which 
specifies an operational mode of the MCH, and an 
Aperture Access Global Enable bit which prevents 
access to an aperture from any port before the aperture 
range and translation table are established. 

MCH Page Policy (PGPOL) Register (052h): This regis- 
ter specifies paging policy attributes include a DRAM 
Refresh Rate (DRR) and a RMC Idle Timer (RIT). The 
DRR field adjusts the DRAM refresh rate and the RIT 
field determines the number of host bus clock cycles 
that the memory controller will remain in the idle state 
before all the open pages are closed. 

MCH RPMR (053h): This register includes a Device 
Napdown Timer (DNT) field, an Active Devices in 
Pool A (ADPA) field, a Device Napdown Enable 
(DNE) field, and a Pool A Capacity (PAC) field. The 
DNT field specifies the number of host clocks the 
memory controller is idle before the least recently used 
device in Pool A is pushed out to Pool B. The ADPA 
field defines the maximum number of RDRAM devices 
in Pool A that can be in Active Read/Write or Active 
state at a time. The devices in Pool A that are not in 
Active Read/Write or Active state are in standby state. 
The DNE bit (when set to 1) enables the channel 
inactivity counter to count continuous inactivity time. 
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When the counter value exceeds the threshold specified 
by DNT, the least recently used device from Pool A is 
pushed to Pool B. The PAC field defines the maximum 
number of RDRAM devices that can reside in Pool A 
at a time. Devices that are not part of Pool A belong to 
Pool B. 

MCH Group Boundary Access (GBA) registers 
(060-6Fh): The GBA registers contain a group ID and 
a value indicating the upper address limit for the group. 

MCH Configuration Registers MCHCFG (OBE-BFh): 
These registers contain the Rambus Frequency & 
DRAM Data Integrity Mode fields. 

Also, at this point powerdown configuration options may 
be programmed. In one embodiment, the self refresh and 
low power self refresh options are set (for each SeriallD- 
Count: SIO Register Write IOP. INIT, SDCA= 
SeriallDCount, DRA=21h, DRD=400h (LSR, if SPD 
supports)+200h (PSR)+80h (SRP)). 

Normal operation may start, as indicated in block 650, 
after a few more registers are programmed for normal 
operation. The page policy register is set to operate normally 
(PGPOL RIT field (MCH 052h [2:0]) to 001b) since the page 
closing timer was effectively disabled for level izing, and the 
power management features are enabled at this point via the 
RPMR register (MCH 053h). If the Pool B Select bit (MCH 
05 Ih [6]) is configured for NAP operation, a broadcast NAP 
entry IOP may be executed to put all devices to the NAP 
state. In the same I/O instruction that sets the IIO bit, set the 
IC bit in RICM also to one so that normal operations of the 
MCH may commence. 

Restoring the Channel when Exiting a Low Power 
State 

After normal operation continues for some time, the 
system may enter a low power state due to system inactivity 
or for another reason, as indicated in block 1000 of FIG. 10. 
One state which the system may enter is a suspend-to-RAM 
(STR) state in which the MCH loses values stored in its 
registers. After entering the STR state, an event which 
causes the system to exit STR may be sensed as indicated in 
block 1010. Accordingly, the BIOS powers up the MCH and 
other system components. The configuration registers of the 
MCH may be automatically reset to a default value in this 
process. 

Accordingly, to again access memory devices on the 
memory channel, at least some of the configuration register 
values are needed. The BIOS may cause the ICH 505 to 
access the battery backed-up memory 590 and restore the 
registers listed below (saved in block 646 of FIG. 6). 

MCH GAR registers (040-047h) 

MCH RDT (050h) 

MCH DRAMC (051h) 

MCH PGPOL (052h) 

MCH RPMR (053h) 

MCH GBA registers (06O-6Fh) 

MCH Configuration Registers MCHCFG (OBE-BFh) 

After restoring values to these registers, the MCH can 
once again access items stored in memory when the STR 
state was entered, including such items as the processor 
context if saved. The memory devices perform self-refresh 
in the STR state so other data is not lost. 

Next, the clock generator is started as indicated in block 
1040. The proper Rambus channel frequency is read from 
the MCH MCHCFG register (MCH OBEh [11], which was 
restored in block 1030). After the clock is allowed to 
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stabilize, the MCH RAC is initialized as indicated in block 
1050. This may be accomplished by executing the MCH 
RAC Initialization IOP. Additionally, the DRD register may 
be loaded with OOOOh and the MCH RAC control register 
load IOP executed to initialize a bus in the RAC (as 
discussed with respect to block 610). 

Next, current calibration is performed as indicated in 
block 1060. This may be performed as discussed with 
respect to block 642 and FIG. 9. In the final iteration 
indicated by block 940, however, the IC bit in the RICM 
register may be set, allowing normal operations to immedi- 
ately commence once the current calibration has completed. 
Thus, the resume from STR sequence may be substantially 
faster than the entire initialization sequence required when 
the system is first powered up since channel levelization, 
SPD querying, ID assignment, and a number of other 
initialization operations may be avoided. 

In conclusion, a method and apparatus for initializing a 
memory device and a memory channel is disclosed. While 
certain exemplary embodiments have been described and 
shown in the accompanying drawings, it is to be understood 
that such embodiments are merely illustrative of and not 
restrictive on the broad invention, and that this invention not 
be limited to the specific constructions and arrangements 
shown and described, since various other modifications may 
occur to those ordinarily skilled in the art upon studying this 
disclosure. 

What is claimed is: 

1. A bus controller comprising: 

a storage location including an initiate initialization 
operation field, wherein setting the initiate initialization 
operation field to a first state causes the bus controller 
to perform an initialization operation; 

a control circuit coupled to perform an initialization 
operation when a value indicating the initialization 
operation is stored in the storage location, the initial- 
ization operation being selected from a plurality of 
predefined memory device initialization operations that 
the control circuit is capable of performing; 

wherein the storage location is a control register, and 
wherein the bus controller further comprises a data 
register, and further wherein at least one of the plurality 
of memory device initialization operations involves 
data exchange between a predefined memory device 
control register and the data register; and 

wherein the control circuit is also coupled to perform the 
initialization operation in response to the value being 
loaded into the control register, wherein the control 
register designates the initialization operation to be 
performed. 

2. The bus controller of claim 1 wherein the data register 
and the control register are both peripheral component 
interconnect (PCI) configuration registers. 

3. The bus controller of claim 1 wherein the initiate 
initialization operation field is reset to a second state when 
the control circuit completes the initialization operation 
designated by the control register. 

4. The bus controller of claim 1 wherein the control 
register comprises: 

an initialization opcode (IOP) field for storing the initial- 
ization operation; 

an initiate initialization operation (HO) field, the IIO field, 
when set to a first state, causing the control circuit to 
execute the initialization operation and then clear the 
IIO field to a second state; 

an initialization complete (IC) field for indicating whether 
an initialization process has completed; 
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a broadcast address field which, when set, causes the 
control circuit to broadcast an 10 P to all devices 
coupled to receive broadcast commands from the bus 
controller; 

a device register address (DRA) field for specifying a 5 
register address for memory device register read and 
write operations; and 

a serial device/channel address (SDA) field for specifying 
a serial device identification value for a first plurality of 
IOPs, a group device identification value for a second 10 
plurality of IOPs, and a bank address for a third 
plurality of IOPs. 

5. The bus controller of claim 1 wherein the initialization 
operation is a memory device core initialization operation 
which causes the control circuit to execute, for N iterations 15 
on each of a plurality of banks: 

a no operation command; 
a refresh command; 

a second no operation command; 20 

a third and a fourth refresh command; 

a third, a fourth, and a fifth no operation command; 

a refresh precharge command; 

a sixth no operation command; 2 5 
a second refresh precharge command; 
a first, a second, and a third calibrate command; and 
a sample command. 

6. The bus controller of claim 1 wherein the initialization 
operation is a temperature calibrate enable and then tern- 30 
perature calibrate operation which causes the control circuit 

to issue a temperature calibrate enable request packet fol- 
lowed by a temperature calibrate request packet to all 
memory devices. 

7. The bus controller of claim 1 wherein the initialization 35 
operation is a current calibrate and current sample operation 
which causes the control circuit to send three current cali- 
brate packets followed by one calibrate and sample packet. 

8. The bus controller of claim 1 wherein the initialization 
operation is an initialize memory interface operation which 40 
causes the control circuit to power up a memory interface of 
the bus controller, to current and temperature calibrate the 
memory interface, and to enable a periodic current and 
temperature calibration of the memory interface. 

9. The bus controller of claim 1 wherein the plurality of 45 
memory device initialization operations include: 

a RDRAM register read command; 
a RDRAM register write command; 

a RDRAM set reset command; 50 

a RDRAM clear reset command; 

a RDRAM set fast clock mode command; 

a RDRAM temperature calibrate enable and then tem- 
perature calibrate command; ss 

a RDRAM Core Initialization (RCI) command; 

a RDRAM Serial I/D (SIO) reset command; 

a RDRAM powerdown exit command; 

a RDRAM powerdown entry command; 

a RDRAM current calibrate and current calibrate and 
sample command; 

a manual current calibration of memory controller hub 
(MCH) Rambus ASIC Cell (RAC) command; 

a load data from the data register into the MCH RAC 55 
control register command; 

an initialize MCH RAC command; 
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a RDRAM nap entry command; 
a RDRAM nap exit command; 
a RDRAM refresh command; and 
a RDRAM precharge command. 

10. The bus controller of claim 1 wherein the control 
circuit further comprising an RDRAM IOP execution circuit 
to execute an IOP corresponding to the selected initialization 
operation. 

11. A system comprising: 
a processor; 

a memory controller coupled to processor, the memory 

controller having a control register; 
a memory bus having a plurality of memory devices 
coupled thereto, the memory bus being coupled to the 
memory controller; and 
an additional memory device coupled to the memory 
controller, the additional memory device being acces- 
sible to the memory controller prior to initializing the 
plurality of memory devices, the additional memory 
device containing a plurality of instructions which, if 
executed by the system, cause the system to perform: 
storing an initialization operand in the control register; 
setting an initiate initialization operation field in the 
control register to a first state to cause the memory 
controller to perform an initialization operation; and 
performing an initialization operation indicated by the 
initialization operand on at least one of the plurality 
of memory devices, said initialization operation 
being selected from a plurality of predefined initial- 
ization operations. 

12. The system of claim 11 wherein the additional 
memory device is a non-volatile memory device and the 
plurality of instructions are part of a basic input/output 
system stored in the non-volatile memory device. 

13. A system comprising: 
a processor; 

a memory bus having a plurality of memory devices 

coupled thereto; 
a memory controller coupled to processor and to the 
memory bus, the memory controller comprising: 
a first storage location including an initiate initializa- 
tion operation field, wherein setting the initiate ini- 
tialization operation field to a first state causes the 
memory controller to perform an initialization opera- 
tion; and 

a control circuit coupled to perform an initialization 
operation when a value indicating the initialization 
operation is stored in the first storage location, the 
initialization operation being selected from a plural- 
ity of memory device initialization operations that 
the control circuit is capable of performing; and 
an additional memory device coupled to the memory 
controller, the additional memory device being acces- 
sible to the memory controller prior to initializing the 
plurality of memory devices, the additional memory 
device containing a plurality of instructions which, if 
executed by the system, cause the system to perform: 
storing an initialization operand indicating the initial- 
ization operation in the first storage location; 
executing the initialization operation indicated by the 
initialization operand on at least one of the plurality 
of memory devices. 

14. The system of claim 13 wherein the first storage 
location is a control register, and wherein the memory 
controller further comprises a data register, and further 
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wherein at least one of the plurality of memory device 
initialization operations involves data exchange between a 
memory device control register and the data register. 

15. The system of claim 14 wherein the first storage 
location is a control register, and wherein the memory 
controller further comprises a data register, and further 
wherein at least one of the plurality of memory device 
initialization operations involves data exchange between a 
memory device control register and the data register. 
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16. The system of claim 15 wherein the plurality of 
instructions stored in the additional memory device, if 
executed, further cause the system to perform polling of the 
initiate initialization operation field to determine when the 
initialization operation completes. 
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